2026-02-17T00:41:13.139 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-17T00:41:13.155 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T00:41:13.233 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48647 branch: wip-ifed-fix-vselector-in-envmode_index_file description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} email: akupczyk@ibm.com first_in_suite: false flavor: default job_id: '48647' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-ifed-fix-vselector-in-envmode_index_file ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 workunit: branch: wip-ifed-fix-vselector-in-envmode_index_file sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 6708 sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 sleep_before_teardown: 0 subset: 582/12264 suite: rados suite_branch: wip-ifed-fix-vselector-in-envmode_index_file suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_03ef619e79a56cd363b087a5c6f19a1a09b49040/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 targets: trial092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBONyHVUrsQ0J/eac9VUcjCktY/Kb0vP7m9V4Pmsb/rMbNA8vOsAnIZPjZwMyqnlHSvkV7fC53fo1wHZXzn5QFo= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-13_08:57:15 tube: trial user: jayaprakash verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T00:41:13.233 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_03ef619e79a56cd363b087a5c6f19a1a09b49040/qa; will attempt to use it 2026-02-17T00:41:13.233 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_03ef619e79a56cd363b087a5c6f19a1a09b49040/qa/tasks 2026-02-17T00:41:13.234 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T00:41:13.237 INFO:teuthology.task.internal:Checking packages... 2026-02-17T00:41:13.237 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '03ef619e79a56cd363b087a5c6f19a1a09b49040' 2026-02-17T00:41:13.237 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T00:41:13.237 INFO:teuthology.packaging:ref: None 2026-02-17T00:41:13.237 INFO:teuthology.packaging:tag: None 2026-02-17T00:41:13.237 INFO:teuthology.packaging:branch: wip-ifed-fix-vselector-in-envmode_index_file 2026-02-17T00:41:13.237 INFO:teuthology.packaging:sha1: 03ef619e79a56cd363b087a5c6f19a1a09b49040 2026-02-17T00:41:13.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-ifed-fix-vselector-in-envmode_index_file 2026-02-17T00:41:13.359 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5225.g03ef619e 2026-02-17T00:41:13.360 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T00:41:13.372 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T00:41:13.372 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T00:41:13.389 INFO:teuthology.task.internal:Saving configuration 2026-02-17T00:41:13.397 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T00:41:13.409 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T00:41:13.488 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial092.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48647', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 00:37:44.153371', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBONyHVUrsQ0J/eac9VUcjCktY/Kb0vP7m9V4Pmsb/rMbNA8vOsAnIZPjZwMyqnlHSvkV7fC53fo1wHZXzn5QFo='} 2026-02-17T00:41:13.488 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T00:41:13.499 INFO:teuthology.task.internal:roles: ubuntu@trial092.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T00:41:13.499 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T00:41:13.587 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7c83a4add440>, signals=[15]) 2026-02-17T00:41:13.587 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T00:41:13.598 INFO:teuthology.task.internal:Opening connections... 2026-02-17T00:41:13.598 DEBUG:teuthology.task.internal:connecting to ubuntu@trial092.front.sepia.ceph.com 2026-02-17T00:41:13.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:41:13.660 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T00:41:13.672 DEBUG:teuthology.orchestra.run.trial092:> uname -m 2026-02-17T00:41:13.738 INFO:teuthology.orchestra.run.trial092.stdout:x86_64 2026-02-17T00:41:13.738 DEBUG:teuthology.orchestra.run.trial092:> cat /etc/os-release 2026-02-17T00:41:13.794 INFO:teuthology.orchestra.run.trial092.stdout:NAME="CentOS Stream" 2026-02-17T00:41:13.794 INFO:teuthology.orchestra.run.trial092.stdout:VERSION="9" 2026-02-17T00:41:13.794 INFO:teuthology.orchestra.run.trial092.stdout:ID="centos" 2026-02-17T00:41:13.794 INFO:teuthology.orchestra.run.trial092.stdout:ID_LIKE="rhel fedora" 2026-02-17T00:41:13.794 INFO:teuthology.orchestra.run.trial092.stdout:VERSION_ID="9" 2026-02-17T00:41:13.794 INFO:teuthology.orchestra.run.trial092.stdout:PLATFORM_ID="platform:el9" 2026-02-17T00:41:13.794 INFO:teuthology.orchestra.run.trial092.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T00:41:13.794 INFO:teuthology.orchestra.run.trial092.stdout:ANSI_COLOR="0;31" 2026-02-17T00:41:13.794 INFO:teuthology.orchestra.run.trial092.stdout:LOGO="fedora-logo-icon" 2026-02-17T00:41:13.794 INFO:teuthology.orchestra.run.trial092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T00:41:13.795 INFO:teuthology.orchestra.run.trial092.stdout:HOME_URL="https://centos.org/" 2026-02-17T00:41:13.795 INFO:teuthology.orchestra.run.trial092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T00:41:13.795 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T00:41:13.795 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T00:41:13.796 INFO:teuthology.lock.ops:Updating trial092.front.sepia.ceph.com on lock server 2026-02-17T00:41:13.889 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T00:41:13.902 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T00:41:13.914 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T00:41:13.914 DEBUG:teuthology.orchestra.run.trial092:> test '!' -e /home/ubuntu/cephtest 2026-02-17T00:41:13.928 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T00:41:13.939 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T00:41:13.939 DEBUG:teuthology.orchestra.run.trial092:> test -z $(ls -A /var/lib/ceph) 2026-02-17T00:41:13.986 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T00:41:14.089 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T00:41:14.113 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T00:41:14.113 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T00:41:14.113 DEBUG:teuthology.orchestra.run.trial092:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T00:41:14.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:41:14.128 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-17T00:41:14.184 INFO:teuthology.orchestra.run.trial092.stdout:5.14.0-645.el9.x86_64 2026-02-17T00:41:14.184 INFO:teuthology.task.kernel:Running kernel on trial092: 5.14.0-645.el9.x86_64 2026-02-17T00:41:14.184 DEBUG:teuthology.orchestra.run.trial092:> sudo yum install -y kernel 2026-02-17T00:41:16.258 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.9 MB 00:01 2026-02-17T00:41:19.557 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 27 MB 00:02 2026-02-17T00:41:23.454 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-17T00:41:24.423 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 20 kB 00:00 2026-02-17T00:41:25.085 INFO:teuthology.orchestra.run.trial092.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2026-02-17T00:41:28.372 INFO:teuthology.orchestra.run.trial092.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-17T00:41:29.391 INFO:teuthology.orchestra.run.trial092.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T00:41:29.411 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:41:29.412 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:41:29.412 INFO:teuthology.orchestra.run.trial092.stdout: Package Architecture Version Repository Size 2026-02-17T00:41:29.412 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:41:29.412 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T00:41:29.412 INFO:teuthology.orchestra.run.trial092.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T00:41:29.412 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-17T00:41:29.412 INFO:teuthology.orchestra.run.trial092.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T00:41:29.412 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T00:41:29.413 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T00:41:29.413 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:41:29.413 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T00:41:29.413 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:41:29.413 INFO:teuthology.orchestra.run.trial092.stdout:Install 4 Packages 2026-02-17T00:41:29.413 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:41:29.413 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 88 M 2026-02-17T00:41:29.413 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 135 M 2026-02-17T00:41:29.413 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T00:41:29.933 INFO:teuthology.orchestra.run.trial092.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2026-02-17T00:41:30.081 INFO:teuthology.orchestra.run.trial092.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 61 MB/s | 17 MB 00:00 2026-02-17T00:41:30.231 INFO:teuthology.orchestra.run.trial092.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 104 MB/s | 31 MB 00:00 2026-02-17T00:41:30.547 INFO:teuthology.orchestra.run.trial092.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 53 MB/s | 40 MB 00:00 2026-02-17T00:41:30.547 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:41:30.547 INFO:teuthology.orchestra.run.trial092.stdout:Total 78 MB/s | 88 MB 00:01 2026-02-17T00:41:30.734 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T00:41:30.942 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T00:41:30.943 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T00:41:31.292 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T00:41:31.292 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T00:41:32.377 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T00:41:32.672 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T00:41:32.691 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:41:34.481 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:41:34.510 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:41:37.537 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:41:37.543 INFO:teuthology.orchestra.run.trial092.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:41:40.578 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:42:11.055 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:42:11.077 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:42:11.144 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:42:11.144 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T00:42:11.144 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T00:42:11.144 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T00:42:11.196 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T00:42:11.196 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:42:11.196 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T00:42:11.196 INFO:teuthology.orchestra.run.trial092.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T00:42:11.196 INFO:teuthology.orchestra.run.trial092.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T00:42:11.196 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T00:42:11.196 INFO:teuthology.orchestra.run.trial092.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T00:42:11.196 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:42:11.196 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:42:11.254 DEBUG:teuthology.orchestra.run.trial092:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T00:42:11.279 INFO:teuthology.orchestra.run.trial092.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T00:42:11.280 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T00:42:11.280 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T00:42:11.280 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T00:42:11.280 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T00:42:11.280 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T00:42:11.280 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial092.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T00:42:11.280 DEBUG:teuthology.orchestra.run.trial092:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T00:42:11.344 INFO:teuthology.orchestra.run.trial092.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T00:42:11.345 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T00:42:11.345 DEBUG:teuthology.orchestra.run.trial092:> sudo rpm -qi grub2-tools 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Name : grub2-tools 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Epoch : 1 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Version : 2.06 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Release : 118.el9 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Architecture: x86_64 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Group : Unspecified 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Size : 8393909 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:License : GPLv3+ 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Packager : builder@centos.org 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Vendor : CentOS 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Summary : Support tools for GRUB. 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:Description : 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:hardware devices. 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:42:11.412 INFO:teuthology.orchestra.run.trial092.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T00:42:11.413 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T00:42:11.414 INFO:teuthology.task.kernel:Updating grub on trial092 to boot 5.14.0-681.el9.x86_64 2026-02-17T00:42:11.414 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T00:42:11.476 INFO:teuthology.orchestra.run.trial092.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T00:42:11.478 DEBUG:teuthology.orchestra.run.trial092:> sudo command -v grubby && echo yes || echo no 2026-02-17T00:42:11.543 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/grubby 2026-02-17T00:42:11.543 INFO:teuthology.orchestra.run.trial092.stdout:yes 2026-02-17T00:42:11.545 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T00:42:11.609 INFO:teuthology.orchestra.run.trial092.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T00:42:11.611 DEBUG:teuthology.orchestra.run.trial092:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T00:42:11.682 DEBUG:teuthology.orchestra.run.trial092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T00:42:11.889 INFO:teuthology.orchestra.run.trial092.stderr:Generating grub configuration file ... 2026-02-17T00:42:11.951 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T00:42:11.958 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T00:42:12.208 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T00:42:12.214 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T00:42:12.246 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T00:42:12.252 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T00:42:12.276 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T00:42:12.283 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T00:42:12.365 INFO:teuthology.orchestra.run.trial092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T00:42:12.373 INFO:teuthology.orchestra.run.trial092.stderr:done 2026-02-17T00:42:12.375 DEBUG:teuthology.orchestra.run.trial092:> test -d /sys/firmware/efi 2026-02-17T00:42:12.392 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T00:42:12.457 INFO:teuthology.orchestra.run.trial092.stdout:/boot/efi/EFI/BOOT 2026-02-17T00:42:12.457 INFO:teuthology.orchestra.run.trial092.stdout:/boot/efi/EFI/centos 2026-02-17T00:42:12.459 DEBUG:teuthology.orchestra.run.trial092:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T00:42:12.526 INFO:teuthology.orchestra.run.trial092.stdout:no 2026-02-17T00:42:12.527 DEBUG:teuthology.orchestra.run.trial092:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T00:42:12.591 INFO:teuthology.orchestra.run.trial092.stdout:yes 2026-02-17T00:42:12.591 DEBUG:teuthology.orchestra.run.trial092:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T00:42:12.655 DEBUG:teuthology.orchestra.run.trial092:> sudo shutdown -r now 2026-02-17T00:42:12.729 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-17T00:42:42.726 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T00:42:42.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-17T00:42:42.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:43:42.775 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T00:43:51.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-17T00:43:51.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:43:51.918 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-17T00:43:52.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-17T00:43:52.074 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T00:43:52.074 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-17T00:43:52.132 INFO:teuthology.orchestra.run.trial092.stdout:5.14.0-681.el9.x86_64 2026-02-17T00:43:52.132 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T00:43:52.132 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T00:43:52.132 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T00:43:53.133 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T00:43:53.133 DEBUG:teuthology.orchestra.run.trial092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T00:43:53.162 INFO:teuthology.orchestra.run.trial092.stdout:ttyS1 2026-02-17T00:43:53.186 DEBUG:teuthology.parallel:result is None 2026-02-17T00:43:53.187 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T00:43:53.197 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T00:43:53.198 DEBUG:teuthology.orchestra.run.trial092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T00:43:53.243 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T00:43:53.257 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T00:43:53.272 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T00:43:53.272 DEBUG:teuthology.orchestra.run.trial092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T00:43:53.304 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T00:43:53.315 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T00:43:53.315 DEBUG:teuthology.orchestra.run.trial092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T00:43:53.363 INFO:teuthology.orchestra.run.trial092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:43:53.371 INFO:teuthology.orchestra.run.trial092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:43:53.373 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T00:43:53.385 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T00:43:53.385 DEBUG:teuthology.orchestra.run.trial092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T00:43:53.437 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T00:43:53.453 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T00:43:53.453 DEBUG:teuthology.orchestra.run.trial092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T00:43:53.494 DEBUG:teuthology.orchestra.run.trial092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:43:53.660 DEBUG:teuthology.orchestra.run.trial092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T00:43:53.690 DEBUG:teuthology.orchestra.run.trial092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:43:53.816 DEBUG:teuthology.orchestra.run.trial092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T00:43:53.841 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T00:43:53.841 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T00:43:53.905 DEBUG:teuthology.orchestra.run.trial092:> sudo service rsyslog restart 2026-02-17T00:43:53.972 INFO:teuthology.orchestra.run.trial092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T00:43:54.449 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T00:43:54.464 INFO:teuthology.task.internal:Starting timer... 2026-02-17T00:43:54.465 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T00:43:54.487 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T00:43:54.508 DEBUG:teuthology.orchestra.run.trial092:> sudo service auditd rotate 2026-02-17T00:43:54.537 INFO:teuthology.orchestra.run.trial092.stdout:Rotating logs: 2026-02-17T00:43:54.538 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T00:43:54.539 DEBUG:teuthology.orchestra.run.trial092:> /usr/sbin/getenforce 2026-02-17T00:43:54.593 INFO:teuthology.orchestra.run.trial092.stdout:Permissive 2026-02-17T00:43:54.594 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial092.front.sepia.ceph.com': 'permissive'} 2026-02-17T00:43:54.594 DEBUG:teuthology.orchestra.run.trial092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T00:43:54.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:43:54.658 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T00:43:54.658 DEBUG:teuthology.orchestra.run.trial092:> sudo /usr/sbin/setenforce permissive 2026-02-17T00:43:54.724 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T00:43:54.739 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-17T00:43:54.742 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-17T00:43:54.862 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T00:43:54.879 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T00:43:54.881 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial092.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T00:46:57.980 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial092.front.sepia.ceph.com')] 2026-02-17T00:46:57.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-17T00:46:57.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T00:46:58.141 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-17T00:46:58.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-17T00:46:58.216 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T00:46:58.229 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T00:46:58.229 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T00:46:58.229 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T00:46:58.283 INFO:teuthology.orchestra.run.trial092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T00:46:58.295 INFO:teuthology.orchestra.run.trial092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T00:46:58.316 INFO:teuthology.orchestra.run.trial092.stderr:sudo: ntpd: command not found 2026-02-17T00:46:58.325 INFO:teuthology.orchestra.run.trial092.stdout:506 Cannot talk to daemon 2026-02-17T00:46:58.337 INFO:teuthology.orchestra.run.trial092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T00:46:58.349 INFO:teuthology.orchestra.run.trial092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T00:46:58.399 INFO:teuthology.orchestra.run.trial092.stderr:bash: line 1: ntpq: command not found 2026-02-17T00:46:58.414 INFO:teuthology.orchestra.run.trial092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T00:46:58.414 INFO:teuthology.orchestra.run.trial092.stdout:=============================================================================== 2026-02-17T00:46:58.414 INFO:teuthology.orchestra.run.trial092.stdout:^? 139-177-202-26.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:46:58.414 INFO:teuthology.orchestra.run.trial092.stdout:^? wsip-24-249-17-253.dc.dc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:46:58.414 INFO:teuthology.orchestra.run.trial092.stdout:^? time-west.far.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:46:58.414 INFO:teuthology.orchestra.run.trial092.stdout:^? 172-234-25-10.ip.linodeu> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T00:46:58.415 INFO:teuthology.run_tasks:Running task install... 2026-02-17T00:46:58.429 DEBUG:teuthology.task.install:project ceph 2026-02-17T00:46:58.430 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '03ef619e79a56cd363b087a5c6f19a1a09b49040'}} 2026-02-17T00:46:58.430 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '03ef619e79a56cd363b087a5c6f19a1a09b49040'} 2026-02-17T00:46:58.430 INFO:teuthology.task.install:Using flavor: default 2026-02-17T00:46:58.440 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T00:46:58.440 INFO:teuthology.task.install:extra packages: [] 2026-02-17T00:46:58.440 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '03ef619e79a56cd363b087a5c6f19a1a09b49040', 'tag': None, 'wait_for_package': False} 2026-02-17T00:46:58.441 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=03ef619e79a56cd363b087a5c6f19a1a09b49040 2026-02-17T00:46:58.600 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/centos/9/flavors/default/ 2026-02-17T00:46:58.600 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5225.g03ef619e 2026-02-17T00:46:58.732 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-ifed-fix-vselector-in-envmode_index_file/03ef619e79a56cd363b087a5c6f19a1a09b49040/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T00:46:58.732 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T00:46:58.732 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T00:46:58.758 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T00:46:58.758 DEBUG:teuthology.orchestra.run.trial092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/03ef619e79a56cd363b087a5c6f19a1a09b49040/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T00:46:58.823 DEBUG:teuthology.orchestra.run.trial092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T00:46:58.896 DEBUG:teuthology.orchestra.run.trial092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T00:46:58.961 INFO:teuthology.orchestra.run.trial092.stdout:check_obsoletes = 1 2026-02-17T00:46:58.963 DEBUG:teuthology.orchestra.run.trial092:> sudo yum clean all 2026-02-17T00:46:59.114 INFO:teuthology.orchestra.run.trial092.stdout:41 files removed 2026-02-17T00:46:59.128 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-radosgw 2026-02-17T00:46:59.396 INFO:teuthology.orchestra.run.trial092.stdout:ceph packages for x86_64 744 kB/s | 94 kB 00:00 2026-02-17T00:46:59.539 INFO:teuthology.orchestra.run.trial092.stdout:ceph noarch packages 210 kB/s | 24 kB 00:00 2026-02-17T00:46:59.665 INFO:teuthology.orchestra.run.trial092.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-17T00:47:00.555 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-17T00:47:15.272 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - AppStream 1.9 MB/s | 27 MB 00:14 2026-02-17T00:47:17.948 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - CRB 29 MB/s | 7.8 MB 00:00 2026-02-17T00:47:19.127 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 20 kB 00:00 2026-02-17T00:47:20.267 INFO:teuthology.orchestra.run.trial092.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-17T00:47:23.456 INFO:teuthology.orchestra.run.trial092.stdout:lab-extras 2.1 MB/s | 50 kB 00:00 2026-02-17T00:47:24.696 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:47:24.698 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:47:24.698 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repository Size 2026-02-17T00:47:24.698 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:47:24.698 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T00:47:24.698 INFO:teuthology.orchestra.run.trial092.stdout: ceph-radosgw x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 13 M 2026-02-17T00:47:24.698 INFO:teuthology.orchestra.run.trial092.stdout:Upgrading: 2026-02-17T00:47:24.698 INFO:teuthology.orchestra.run.trial092.stdout: librados2 x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 3.5 M 2026-02-17T00:47:24.698 INFO:teuthology.orchestra.run.trial092.stdout: librbd1 x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 2.8 M 2026-02-17T00:47:24.698 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: ceph-base x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 5.2 M 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: ceph-common x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 24 M 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: ceph-selinux x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 25 k 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs2 x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 908 k 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T00:47:24.699 INFO:teuthology.orchestra.run.trial092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: libradosstriper1 x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 248 k 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: librgw2 x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 6.5 M 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-argparse x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 45 k 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-common x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 185 k 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: python3-cephfs x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 203 k 2026-02-17T00:47:24.700 INFO:teuthology.orchestra.run.trial092.stdout: python3-rados x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 324 k 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout: python3-rbd x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 305 k 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout: python3-rgw x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 100 k 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout:Installing weak dependencies: 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-daemon x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 36 k 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 25 k 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:24.701 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T00:47:24.702 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:47:24.702 INFO:teuthology.orchestra.run.trial092.stdout:Install 35 Packages 2026-02-17T00:47:24.702 INFO:teuthology.orchestra.run.trial092.stdout:Upgrade 2 Packages 2026-02-17T00:47:24.702 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:24.703 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 68 M 2026-02-17T00:47:24.703 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T00:47:25.298 INFO:teuthology.orchestra.run.trial092.stdout:(1/37): ceph-base-20.3.0-5225.g03ef619e.el9.x86 18 MB/s | 5.2 MB 00:00 2026-02-17T00:47:25.332 INFO:teuthology.orchestra.run.trial092.stdout:(2/37): ceph-selinux-20.3.0-5225.g03ef619e.el9. 731 kB/s | 25 kB 00:00 2026-02-17T00:47:25.371 INFO:teuthology.orchestra.run.trial092.stdout:(3/37): libcephfs-daemon-20.3.0-5225.g03ef619e. 959 kB/s | 36 kB 00:00 2026-02-17T00:47:25.410 INFO:teuthology.orchestra.run.trial092.stdout:(4/37): libcephfs-proxy2-20.3.0-5225.g03ef619e. 623 kB/s | 25 kB 00:00 2026-02-17T00:47:25.469 INFO:teuthology.orchestra.run.trial092.stdout:(5/37): libcephfs2-20.3.0-5225.g03ef619e.el9.x8 15 MB/s | 908 kB 00:00 2026-02-17T00:47:25.517 INFO:teuthology.orchestra.run.trial092.stdout:(6/37): libradosstriper1-20.3.0-5225.g03ef619e. 5.0 MB/s | 248 kB 00:00 2026-02-17T00:47:25.815 INFO:teuthology.orchestra.run.trial092.stdout:(7/37): ceph-radosgw-20.3.0-5225.g03ef619e.el9. 16 MB/s | 13 MB 00:00 2026-02-17T00:47:25.841 INFO:teuthology.orchestra.run.trial092.stdout:(8/37): python3-ceph-argparse-20.3.0-5225.g03ef 1.7 MB/s | 45 kB 00:00 2026-02-17T00:47:25.873 INFO:teuthology.orchestra.run.trial092.stdout:(9/37): librgw2-20.3.0-5225.g03ef619e.el9.x86_6 18 MB/s | 6.5 MB 00:00 2026-02-17T00:47:25.879 INFO:teuthology.orchestra.run.trial092.stdout:(10/37): python3-ceph-common-20.3.0-5225.g03ef6 4.8 MB/s | 185 kB 00:00 2026-02-17T00:47:25.902 INFO:teuthology.orchestra.run.trial092.stdout:(11/37): python3-cephfs-20.3.0-5225.g03ef619e.e 6.8 MB/s | 203 kB 00:00 2026-02-17T00:47:25.909 INFO:teuthology.orchestra.run.trial092.stdout:(12/37): python3-rados-20.3.0-5225.g03ef619e.el 10 MB/s | 324 kB 00:00 2026-02-17T00:47:25.933 INFO:teuthology.orchestra.run.trial092.stdout:(13/37): python3-rbd-20.3.0-5225.g03ef619e.el9. 9.7 MB/s | 305 kB 00:00 2026-02-17T00:47:25.937 INFO:teuthology.orchestra.run.trial092.stdout:(14/37): python3-rgw-20.3.0-5225.g03ef619e.el9. 3.5 MB/s | 100 kB 00:00 2026-02-17T00:47:25.996 INFO:teuthology.orchestra.run.trial092.stdout:(15/37): ceph-common-20.3.0-5225.g03ef619e.el9. 24 MB/s | 24 MB 00:00 2026-02-17T00:47:26.196 INFO:teuthology.orchestra.run.trial092.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 126 kB/s | 33 kB 00:00 2026-02-17T00:47:26.384 INFO:teuthology.orchestra.run.trial092.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 240 kB/s | 93 kB 00:00 2026-02-17T00:47:26.622 INFO:teuthology.orchestra.run.trial092.stdout:(18/37): nvme-cli-2.13-1.el9.x86_64.rpm 1.6 MB/s | 1.1 MB 00:00 2026-02-17T00:47:26.816 INFO:teuthology.orchestra.run.trial092.stdout:(19/37): boost-program-options-1.75.0-13.el9.x8 168 kB/s | 104 kB 00:00 2026-02-17T00:47:26.921 INFO:teuthology.orchestra.run.trial092.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 433 kB/s | 45 kB 00:00 2026-02-17T00:47:27.059 INFO:teuthology.orchestra.run.trial092.stdout:(21/37): libnbd-1.20.3-4.el9.x86_64.rpm 243 kB/s | 164 kB 00:00 2026-02-17T00:47:27.228 INFO:teuthology.orchestra.run.trial092.stdout:(22/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 264 kB/s | 160 kB 00:00 2026-02-17T00:47:27.422 INFO:teuthology.orchestra.run.trial092.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 1.2 MB/s | 240 kB 00:00 2026-02-17T00:47:27.487 INFO:teuthology.orchestra.run.trial092.stdout:(24/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 684 kB/s | 292 kB 00:00 2026-02-17T00:47:27.525 INFO:teuthology.orchestra.run.trial092.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 359 kB/s | 37 kB 00:00 2026-02-17T00:47:27.590 INFO:teuthology.orchestra.run.trial092.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 645 kB/s | 66 kB 00:00 2026-02-17T00:47:27.770 INFO:teuthology.orchestra.run.trial092.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.2 MB/s | 308 kB 00:00 2026-02-17T00:47:27.775 INFO:teuthology.orchestra.run.trial092.stdout:(28/37): librdkafka-1.6.1-102.el9.x86_64.rpm 775 kB/s | 662 kB 00:00 2026-02-17T00:47:27.807 INFO:teuthology.orchestra.run.trial092.stdout:(29/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 665 kB/s | 25 kB 00:00 2026-02-17T00:47:27.847 INFO:teuthology.orchestra.run.trial092.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.7 MB/s | 67 kB 00:00 2026-02-17T00:47:27.923 INFO:teuthology.orchestra.run.trial092.stdout:(31/37): liboath-2.6.12-1.el9.x86_64.rpm 332 kB/s | 49 kB 00:00 2026-02-17T00:47:27.949 INFO:teuthology.orchestra.run.trial092.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 8.0 MB/s | 838 kB 00:00 2026-02-17T00:47:27.999 INFO:teuthology.orchestra.run.trial092.stdout:(33/37): libarrow-9.0.0-15.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2026-02-17T00:47:28.038 INFO:teuthology.orchestra.run.trial092.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 18 MB/s | 1.6 MB 00:00 2026-02-17T00:47:28.040 INFO:teuthology.orchestra.run.trial092.stdout:(35/37): re2-20211101-20.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2026-02-17T00:47:28.121 INFO:teuthology.orchestra.run.trial092.stdout:(36/37): librados2-20.3.0-5225.g03ef619e.el9.x8 29 MB/s | 3.5 MB 00:00 2026-02-17T00:47:28.162 INFO:teuthology.orchestra.run.trial092.stdout:(37/37): librbd1-20.3.0-5225.g03ef619e.el9.x86_ 23 MB/s | 2.8 MB 00:00 2026-02-17T00:47:28.166 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:47:28.166 INFO:teuthology.orchestra.run.trial092.stdout:Total 20 MB/s | 68 MB 00:03 2026-02-17T00:47:28.264 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T00:47:28.282 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T00:47:28.282 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T00:47:28.535 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T00:47:28.536 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T00:47:28.845 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T00:47:28.996 INFO:teuthology.orchestra.run.trial092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-17T00:47:29.000 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : librados2-2:20.3.0-5225.g03ef619e.el9.x86_64 2/39 2026-02-17T00:47:29.051 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librados2-2:20.3.0-5225.g03ef619e.el9.x86_64 2/39 2026-02-17T00:47:29.052 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephfs2-2:20.3.0-5225.g03ef619e.el9.x86_64 3/39 2026-02-17T00:47:29.064 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libcephfs2-2:20.3.0-5225.g03ef619e.el9.x86_64 3/39 2026-02-17T00:47:29.066 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephfs-daemon-2:20.3.0-5225.g03ef619e.el9.x86_6 4/39 2026-02-17T00:47:29.067 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephfs-proxy2-2:20.3.0-5225.g03ef619e.el9.x86_6 5/39 2026-02-17T00:47:29.095 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5225.g03ef619e.el9.x86_6 5/39 2026-02-17T00:47:29.097 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rados-2:20.3.0-5225.g03ef619e.el9.x86_64 6/39 2026-02-17T00:47:29.105 INFO:teuthology.orchestra.run.trial092.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-17T00:47:29.109 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-17T00:47:29.112 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-17T00:47:29.117 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-17T00:47:29.127 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-ceph-argparse-2:20.3.0-5225.g03ef619e.el9. 11/39 2026-02-17T00:47:29.139 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cephfs-2:20.3.0-5225.g03ef619e.el9.x86_64 12/39 2026-02-17T00:47:29.140 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libradosstriper1-2:20.3.0-5225.g03ef619e.el9.x86_6 13/39 2026-02-17T00:47:29.163 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5225.g03ef619e.el9.x86_6 13/39 2026-02-17T00:47:29.167 INFO:teuthology.orchestra.run.trial092.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-17T00:47:29.201 INFO:teuthology.orchestra.run.trial092.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-17T00:47:29.204 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-17T00:47:29.210 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-17T00:47:29.212 INFO:teuthology.orchestra.run.trial092.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-17T00:47:29.217 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-17T00:47:29.337 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T00:47:29.338 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : librbd1-2:20.3.0-5225.g03ef619e.el9.x86_64 21/39 2026-02-17T00:47:29.365 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librbd1-2:20.3.0-5225.g03ef619e.el9.x86_64 21/39 2026-02-17T00:47:29.367 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rbd-2:20.3.0-5225.g03ef619e.el9.x86_64 22/39 2026-02-17T00:47:29.373 INFO:teuthology.orchestra.run.trial092.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-17T00:47:29.655 INFO:teuthology.orchestra.run.trial092.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-17T00:47:29.656 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librgw2-2:20.3.0-5225.g03ef619e.el9.x86_64 25/39 2026-02-17T00:47:29.675 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librgw2-2:20.3.0-5225.g03ef619e.el9.x86_64 25/39 2026-02-17T00:47:29.679 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rgw-2:20.3.0-5225.g03ef619e.el9.x86_64 26/39 2026-02-17T00:47:29.684 INFO:teuthology.orchestra.run.trial092.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-17T00:47:29.686 INFO:teuthology.orchestra.run.trial092.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-17T00:47:29.687 INFO:teuthology.orchestra.run.trial092.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T00:47:29.706 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-17T00:47:29.820 INFO:teuthology.orchestra.run.trial092.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-17T00:47:29.822 INFO:teuthology.orchestra.run.trial092.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T00:47:30.116 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-17T00:47:30.116 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T00:47:30.116 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:30.159 INFO:teuthology.orchestra.run.trial092.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-17T00:47:30.161 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-ceph-common-2:20.3.0-5225.g03ef619e.el9.x8 33/39 2026-02-17T00:47:31.250 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-common-2:20.3.0-5225.g03ef619e.el9.x86_64 34/39 2026-02-17T00:47:31.253 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-common-2:20.3.0-5225.g03ef619e.el9.x86_64 34/39 2026-02-17T00:47:31.517 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-common-2:20.3.0-5225.g03ef619e.el9.x86_64 34/39 2026-02-17T00:47:31.520 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-base-2:20.3.0-5225.g03ef619e.el9.x86_64 35/39 2026-02-17T00:47:31.564 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-base-2:20.3.0-5225.g03ef619e.el9.x86_64 35/39 2026-02-17T00:47:31.565 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T00:47:31.565 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T00:47:31.565 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:31.568 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-selinux-2:20.3.0-5225.g03ef619e.el9.x86_64 36/39 2026-02-17T00:47:36.137 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5225.g03ef619e.el9.x86_64 36/39 2026-02-17T00:47:36.137 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /sys 2026-02-17T00:47:36.137 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /proc 2026-02-17T00:47:36.137 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /mnt 2026-02-17T00:47:36.137 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /var/tmp 2026-02-17T00:47:36.138 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /home 2026-02-17T00:47:36.138 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /root 2026-02-17T00:47:36.138 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /tmp 2026-02-17T00:47:36.138 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:36.712 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-radosgw-2:20.3.0-5225.g03ef619e.el9.x86_64 37/39 2026-02-17T00:47:36.736 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5225.g03ef619e.el9.x86_64 37/39 2026-02-17T00:47:36.736 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:47:36.736 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T00:47:36.736 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T00:47:36.736 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T00:47:36.736 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:36.737 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T00:47:36.750 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-17T00:47:36.750 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T00:47:36.805 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T00:47:36.806 INFO:teuthology.orchestra.run.trial092.stdout:Creating group 'qat' with GID 992. 2026-02-17T00:47:36.806 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:37.090 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-base-2:20.3.0-5225.g03ef619e.el9.x86_64 1/39 2026-02-17T00:47:37.090 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-common-2:20.3.0-5225.g03ef619e.el9.x86_64 2/39 2026-02-17T00:47:37.090 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-radosgw-2:20.3.0-5225.g03ef619e.el9.x86_64 3/39 2026-02-17T00:47:37.090 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-selinux-2:20.3.0-5225.g03ef619e.el9.x86_64 4/39 2026-02-17T00:47:37.090 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephfs-daemon-2:20.3.0-5225.g03ef619e.el9.x86_6 5/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5225.g03ef619e.el9.x86_6 6/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephfs2-2:20.3.0-5225.g03ef619e.el9.x86_64 7/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libradosstriper1-2:20.3.0-5225.g03ef619e.el9.x86_6 8/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librgw2-2:20.3.0-5225.g03ef619e.el9.x86_64 9/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5225.g03ef619e.el9. 10/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-ceph-common-2:20.3.0-5225.g03ef619e.el9.x8 11/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cephfs-2:20.3.0-5225.g03ef619e.el9.x86_64 12/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rados-2:20.3.0-5225.g03ef619e.el9.x86_64 13/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rbd-2:20.3.0-5225.g03ef619e.el9.x86_64 14/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rgw-2:20.3.0-5225.g03ef619e.el9.x86_64 15/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-17T00:47:37.091 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librados2-2:20.3.0-5225.g03ef619e.el9.x86_64 36/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-17T00:47:37.092 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librbd1-2:20.3.0-5225.g03ef619e.el9.x86_64 38/39 2026-02-17T00:47:37.151 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout:Upgraded: 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: librados2-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: librbd1-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: ceph-base-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: ceph-common-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: ceph-radosgw-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: ceph-selinux-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-daemon-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-proxy2-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs2-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T00:47:37.152 INFO:teuthology.orchestra.run.trial092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: libradosstriper1-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: librgw2-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-argparse-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-common-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: python3-cephfs-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: python3-rados-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: python3-rbd-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: python3-rgw-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:37.153 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:47:37.194 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-test 2026-02-17T00:47:37.509 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:14 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:47:37.591 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:47:37.591 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:47:37.591 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repository Size 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: ceph-test x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 76 M 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: libcephsqlite x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 159 k 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout:Install 10 Packages 2026-02-17T00:47:37.592 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:37.593 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 80 M 2026-02-17T00:47:37.593 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 331 M 2026-02-17T00:47:37.593 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T00:47:38.235 INFO:teuthology.orchestra.run.trial092.stdout:(1/10): libcephsqlite-20.3.0-5225.g03ef619e.el9 1.7 MB/s | 159 kB 00:00 2026-02-17T00:47:38.482 INFO:teuthology.orchestra.run.trial092.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 92 kB/s | 23 kB 00:00 2026-02-17T00:47:38.719 INFO:teuthology.orchestra.run.trial092.stdout:(3/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 396 kB/s | 94 kB 00:00 2026-02-17T00:47:38.742 INFO:teuthology.orchestra.run.trial092.stdout:(4/10): libxslt-1.1.34-12.el9.x86_64.rpm 10 MB/s | 233 kB 00:00 2026-02-17T00:47:38.772 INFO:teuthology.orchestra.run.trial092.stdout:(5/10): protobuf-3.14.0-17.el9.x86_64.rpm 33 MB/s | 1.0 MB 00:00 2026-02-17T00:47:38.782 INFO:teuthology.orchestra.run.trial092.stdout:(6/10): socat-1.7.4.1-8.el9.x86_64.rpm 33 MB/s | 303 kB 00:00 2026-02-17T00:47:38.789 INFO:teuthology.orchestra.run.trial092.stdout:(7/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 8.7 MB/s | 64 kB 00:00 2026-02-17T00:47:38.882 INFO:teuthology.orchestra.run.trial092.stdout:(8/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.8 MB/s | 2.1 MB 00:00 2026-02-17T00:47:39.098 INFO:teuthology.orchestra.run.trial092.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 394 kB/s | 122 kB 00:00 2026-02-17T00:47:39.655 INFO:teuthology.orchestra.run.trial092.stdout:(10/10): ceph-test-20.3.0-5225.g03ef619e.el9.x8 50 MB/s | 76 MB 00:01 2026-02-17T00:47:39.657 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:47:39.657 INFO:teuthology.orchestra.run.trial092.stdout:Total 39 MB/s | 80 MB 00:02 2026-02-17T00:47:39.723 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T00:47:39.734 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T00:47:39.734 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T00:47:40.011 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T00:47:40.011 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T00:47:40.319 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T00:47:40.328 INFO:teuthology.orchestra.run.trial092.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-17T00:47:40.337 INFO:teuthology.orchestra.run.trial092.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-17T00:47:40.342 INFO:teuthology.orchestra.run.trial092.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-17T00:47:40.346 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-17T00:47:40.351 INFO:teuthology.orchestra.run.trial092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-17T00:47:40.353 INFO:teuthology.orchestra.run.trial092.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-17T00:47:40.363 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-17T00:47:40.371 INFO:teuthology.orchestra.run.trial092.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-17T00:47:40.372 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephsqlite-2:20.3.0-5225.g03ef619e.el9.x86_64 9/10 2026-02-17T00:47:43.772 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5225.g03ef619e.el9.x86_64 9/10 2026-02-17T00:47:43.790 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-test-2:20.3.0-5225.g03ef619e.el9.x86_64 10/10 2026-02-17T00:47:44.116 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-test-2:20.3.0-5225.g03ef619e.el9.x86_64 10/10 2026-02-17T00:47:44.116 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-test-2:20.3.0-5225.g03ef619e.el9.x86_64 1/10 2026-02-17T00:47:44.116 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephsqlite-2:20.3.0-5225.g03ef619e.el9.x86_64 2/10 2026-02-17T00:47:44.117 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-17T00:47:44.117 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-17T00:47:44.117 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-17T00:47:44.117 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-17T00:47:44.117 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-17T00:47:44.117 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-17T00:47:44.117 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-17T00:47:44.170 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-17T00:47:44.170 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:44.171 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T00:47:44.171 INFO:teuthology.orchestra.run.trial092.stdout: ceph-test-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:44.171 INFO:teuthology.orchestra.run.trial092.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-17T00:47:44.171 INFO:teuthology.orchestra.run.trial092.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-17T00:47:44.171 INFO:teuthology.orchestra.run.trial092.stdout: libcephsqlite-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:47:44.171 INFO:teuthology.orchestra.run.trial092.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T00:47:44.171 INFO:teuthology.orchestra.run.trial092.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-17T00:47:44.172 INFO:teuthology.orchestra.run.trial092.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T00:47:44.172 INFO:teuthology.orchestra.run.trial092.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T00:47:44.172 INFO:teuthology.orchestra.run.trial092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T00:47:44.172 INFO:teuthology.orchestra.run.trial092.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-17T00:47:44.172 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:44.172 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:47:44.207 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph 2026-02-17T00:47:44.527 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:21 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:47:44.612 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:47:44.615 INFO:teuthology.orchestra.run.trial092.stdout:======================================================================================= 2026-02-17T00:47:44.615 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repository Size 2026-02-17T00:47:44.615 INFO:teuthology.orchestra.run.trial092.stdout:======================================================================================= 2026-02-17T00:47:44.615 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T00:47:44.615 INFO:teuthology.orchestra.run.trial092.stdout: ceph x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 6.5 k 2026-02-17T00:47:44.615 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-17T00:47:44.616 INFO:teuthology.orchestra.run.trial092.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T00:47:44.616 INFO:teuthology.orchestra.run.trial092.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5225.g03ef619e.el9 ceph-noarch 57 k 2026-02-17T00:47:44.616 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mds x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 2.4 M 2026-02-17T00:47:44.616 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 936 k 2026-02-17T00:47:44.616 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5225.g03ef619e.el9 ceph-noarch 297 k 2026-02-17T00:47:44.616 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mon x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 5.0 M 2026-02-17T00:47:44.616 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 167 k 2026-02-17T00:47:44.616 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-classic x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 16 M 2026-02-17T00:47:44.616 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-crimson x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 19 M 2026-02-17T00:47:44.616 INFO:teuthology.orchestra.run.trial092.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5225.g03ef619e.el9 ceph-noarch 17 k 2026-02-17T00:47:44.616 INFO:teuthology.orchestra.run.trial092.stdout: cephadm noarch 2:20.3.0-5225.g03ef619e.el9 ceph-noarch 1.0 M 2026-02-17T00:47:44.617 INFO:teuthology.orchestra.run.trial092.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T00:47:44.617 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T00:47:44.617 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T00:47:44.617 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T00:47:44.617 INFO:teuthology.orchestra.run.trial092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T00:47:44.617 INFO:teuthology.orchestra.run.trial092.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T00:47:44.617 INFO:teuthology.orchestra.run.trial092.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T00:47:44.618 INFO:teuthology.orchestra.run.trial092.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T00:47:44.618 INFO:teuthology.orchestra.run.trial092.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T00:47:44.618 INFO:teuthology.orchestra.run.trial092.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T00:47:44.618 INFO:teuthology.orchestra.run.trial092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T00:47:44.618 INFO:teuthology.orchestra.run.trial092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T00:47:44.618 INFO:teuthology.orchestra.run.trial092.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T00:47:44.618 INFO:teuthology.orchestra.run.trial092.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T00:47:44.619 INFO:teuthology.orchestra.run.trial092.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T00:47:44.619 INFO:teuthology.orchestra.run.trial092.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T00:47:44.619 INFO:teuthology.orchestra.run.trial092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T00:47:44.619 INFO:teuthology.orchestra.run.trial092.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T00:47:44.619 INFO:teuthology.orchestra.run.trial092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T00:47:44.619 INFO:teuthology.orchestra.run.trial092.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T00:47:44.620 INFO:teuthology.orchestra.run.trial092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T00:47:44.620 INFO:teuthology.orchestra.run.trial092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T00:47:44.620 INFO:teuthology.orchestra.run.trial092.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T00:47:44.620 INFO:teuthology.orchestra.run.trial092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T00:47:44.620 INFO:teuthology.orchestra.run.trial092.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T00:47:44.620 INFO:teuthology.orchestra.run.trial092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T00:47:44.620 INFO:teuthology.orchestra.run.trial092.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T00:47:44.620 INFO:teuthology.orchestra.run.trial092.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T00:47:44.620 INFO:teuthology.orchestra.run.trial092.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T00:47:44.621 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T00:47:44.621 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T00:47:44.621 INFO:teuthology.orchestra.run.trial092.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T00:47:44.621 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T00:47:44.621 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T00:47:44.621 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T00:47:44.621 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T00:47:44.622 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T00:47:44.622 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T00:47:44.622 INFO:teuthology.orchestra.run.trial092.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T00:47:44.622 INFO:teuthology.orchestra.run.trial092.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-17T00:47:44.622 INFO:teuthology.orchestra.run.trial092.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T00:47:44.622 INFO:teuthology.orchestra.run.trial092.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T00:47:44.622 INFO:teuthology.orchestra.run.trial092.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T00:47:44.622 INFO:teuthology.orchestra.run.trial092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T00:47:44.622 INFO:teuthology.orchestra.run.trial092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T00:47:44.623 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T00:47:44.624 INFO:teuthology.orchestra.run.trial092.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T00:47:44.625 INFO:teuthology.orchestra.run.trial092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T00:47:44.625 INFO:teuthology.orchestra.run.trial092.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T00:47:44.625 INFO:teuthology.orchestra.run.trial092.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T00:47:44.625 INFO:teuthology.orchestra.run.trial092.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T00:47:44.625 INFO:teuthology.orchestra.run.trial092.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T00:47:44.625 INFO:teuthology.orchestra.run.trial092.stdout:Installing weak dependencies: 2026-02-17T00:47:44.625 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5225.g03ef619e.el9 ceph-noarch 184 k 2026-02-17T00:47:44.625 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5225.g03ef619e.el9 ceph-noarch 51 M 2026-02-17T00:47:44.625 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5225.g03ef619e.el9 ceph-noarch 7.4 M 2026-02-17T00:47:44.625 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5225.g03ef619e.el9 ceph-noarch 22 k 2026-02-17T00:47:44.625 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-rook noarch 2:20.3.0-5225.g03ef619e.el9 ceph-noarch 50 k 2026-02-17T00:47:44.626 INFO:teuthology.orchestra.run.trial092.stdout: ceph-volume noarch 2:20.3.0-5225.g03ef619e.el9 ceph-noarch 299 k 2026-02-17T00:47:44.626 INFO:teuthology.orchestra.run.trial092.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T00:47:44.626 INFO:teuthology.orchestra.run.trial092.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T00:47:44.626 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:44.626 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T00:47:44.626 INFO:teuthology.orchestra.run.trial092.stdout:======================================================================================= 2026-02-17T00:47:44.626 INFO:teuthology.orchestra.run.trial092.stdout:Install 96 Packages 2026-02-17T00:47:44.626 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:44.627 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 158 M 2026-02-17T00:47:44.627 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 732 M 2026-02-17T00:47:44.627 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T00:47:44.973 INFO:teuthology.orchestra.run.trial092.stdout:(1/96): ceph-20.3.0-5225.g03ef619e.el9.x86_64.r 129 kB/s | 6.5 kB 00:00 2026-02-17T00:47:45.147 INFO:teuthology.orchestra.run.trial092.stdout:(2/96): ceph-mgr-20.3.0-5225.g03ef619e.el9.x86_ 4.1 MB/s | 936 kB 00:00 2026-02-17T00:47:45.206 INFO:teuthology.orchestra.run.trial092.stdout:(3/96): ceph-osd-20.3.0-5225.g03ef619e.el9.x86_ 2.8 MB/s | 167 kB 00:00 2026-02-17T00:47:45.305 INFO:teuthology.orchestra.run.trial092.stdout:(4/96): ceph-mds-20.3.0-5225.g03ef619e.el9.x86_ 6.2 MB/s | 2.4 MB 00:00 2026-02-17T00:47:45.783 INFO:teuthology.orchestra.run.trial092.stdout:(5/96): ceph-mon-20.3.0-5225.g03ef619e.el9.x86_ 6.1 MB/s | 5.0 MB 00:00 2026-02-17T00:47:45.822 INFO:teuthology.orchestra.run.trial092.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5225.g03 1.4 MB/s | 57 kB 00:00 2026-02-17T00:47:45.865 INFO:teuthology.orchestra.run.trial092.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5225.g03ef619e. 4.2 MB/s | 184 kB 00:00 2026-02-17T00:47:46.757 INFO:teuthology.orchestra.run.trial092.stdout:(8/96): ceph-osd-crimson-20.3.0-5225.g03ef619e. 13 MB/s | 19 MB 00:01 2026-02-17T00:47:46.899 INFO:teuthology.orchestra.run.trial092.stdout:(9/96): ceph-osd-classic-20.3.0-5225.g03ef619e. 9.2 MB/s | 16 MB 00:01 2026-02-17T00:47:46.941 INFO:teuthology.orchestra.run.trial092.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5225.g03ef61 539 kB/s | 22 kB 00:00 2026-02-17T00:47:46.963 INFO:teuthology.orchestra.run.trial092.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5225.g03e 13 MB/s | 297 kB 00:00 2026-02-17T00:47:46.982 INFO:teuthology.orchestra.run.trial092.stdout:(12/96): ceph-mgr-rook-20.3.0-5225.g03ef619e.el 2.6 MB/s | 50 kB 00:00 2026-02-17T00:47:46.998 INFO:teuthology.orchestra.run.trial092.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5225.g03 1.0 MB/s | 17 kB 00:00 2026-02-17T00:47:47.020 INFO:teuthology.orchestra.run.trial092.stdout:(14/96): ceph-volume-20.3.0-5225.g03ef619e.el9. 13 MB/s | 299 kB 00:00 2026-02-17T00:47:47.086 INFO:teuthology.orchestra.run.trial092.stdout:(15/96): cephadm-20.3.0-5225.g03ef619e.el9.noar 16 MB/s | 1.0 MB 00:00 2026-02-17T00:47:47.130 INFO:teuthology.orchestra.run.trial092.stdout:(16/96): ceph-mgr-diskprediction-local-20.3.0-5 20 MB/s | 7.4 MB 00:00 2026-02-17T00:47:47.707 INFO:teuthology.orchestra.run.trial092.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-17T00:47:48.068 INFO:teuthology.orchestra.run.trial092.stdout:(18/96): cryptsetup-2.8.1-2.el9.x86_64.rpm 357 kB/s | 350 kB 00:00 2026-02-17T00:47:48.114 INFO:teuthology.orchestra.run.trial092.stdout:(19/96): libconfig-1.7.2-9.el9.x86_64.rpm 177 kB/s | 72 kB 00:00 2026-02-17T00:47:48.227 INFO:teuthology.orchestra.run.trial092.stdout:(20/96): ceph-mgr-dashboard-20.3.0-5225.g03ef61 21 MB/s | 51 MB 00:02 2026-02-17T00:47:48.874 INFO:teuthology.orchestra.run.trial092.stdout:(21/96): libquadmath-11.5.0-14.el9.x86_64.rpm 243 kB/s | 184 kB 00:00 2026-02-17T00:47:49.051 INFO:teuthology.orchestra.run.trial092.stdout:(22/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 307 kB/s | 253 kB 00:00 2026-02-17T00:47:49.125 INFO:teuthology.orchestra.run.trial092.stdout:(23/96): libgfortran-11.5.0-14.el9.x86_64.rpm 752 kB/s | 794 kB 00:01 2026-02-17T00:47:49.217 INFO:teuthology.orchestra.run.trial092.stdout:(24/96): python3-ply-3.11-14.el9.noarch.rpm 644 kB/s | 106 kB 00:00 2026-02-17T00:47:49.373 INFO:teuthology.orchestra.run.trial092.stdout:(25/96): python3-pycparser-2.20-6.el9.noarch.rp 544 kB/s | 135 kB 00:00 2026-02-17T00:47:49.382 INFO:teuthology.orchestra.run.trial092.stdout:(26/96): python3-pyparsing-2.4.7-9.el9.noarch.r 910 kB/s | 150 kB 00:00 2026-02-17T00:47:49.538 INFO:teuthology.orchestra.run.trial092.stdout:(27/96): python3-requests-2.25.1-10.el9.noarch. 766 kB/s | 126 kB 00:00 2026-02-17T00:47:49.703 INFO:teuthology.orchestra.run.trial092.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 1.1 MB/s | 182 kB 00:00 2026-02-17T00:47:49.793 INFO:teuthology.orchestra.run.trial092.stdout:(29/96): python3-urllib3-1.26.5-7.el9.noarch.rp 530 kB/s | 218 kB 00:00 2026-02-17T00:47:49.828 INFO:teuthology.orchestra.run.trial092.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 848 kB/s | 30 kB 00:00 2026-02-17T00:47:49.869 INFO:teuthology.orchestra.run.trial092.stdout:(31/96): zip-3.0-35.el9.x86_64.rpm 1.6 MB/s | 266 kB 00:00 2026-02-17T00:47:49.885 INFO:teuthology.orchestra.run.trial092.stdout:(32/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 53 MB/s | 3.0 MB 00:00 2026-02-17T00:47:49.892 INFO:teuthology.orchestra.run.trial092.stdout:(33/96): flexiblas-openblas-openmp-3.0.4-9.el9. 654 kB/s | 15 kB 00:00 2026-02-17T00:47:49.895 INFO:teuthology.orchestra.run.trial092.stdout:(34/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 23 MB/s | 246 kB 00:00 2026-02-17T00:47:49.904 INFO:teuthology.orchestra.run.trial092.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 4.9 MB/s | 42 kB 00:00 2026-02-17T00:47:49.922 INFO:teuthology.orchestra.run.trial092.stdout:(36/96): lua-5.4.4-4.el9.x86_64.rpm 6.2 MB/s | 188 kB 00:00 2026-02-17T00:47:49.931 INFO:teuthology.orchestra.run.trial092.stdout:(37/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 195 MB/s | 5.3 MB 00:00 2026-02-17T00:47:49.944 INFO:teuthology.orchestra.run.trial092.stdout:(38/96): python3-devel-3.9.25-2.el9.x86_64.rpm 18 MB/s | 244 kB 00:00 2026-02-17T00:47:49.957 INFO:teuthology.orchestra.run.trial092.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 19 MB/s | 249 kB 00:00 2026-02-17T00:47:49.967 INFO:teuthology.orchestra.run.trial092.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 4.9 MB/s | 48 kB 00:00 2026-02-17T00:47:49.978 INFO:teuthology.orchestra.run.trial092.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 16 MB/s | 177 kB 00:00 2026-02-17T00:47:49.994 INFO:teuthology.orchestra.run.trial092.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 73 MB/s | 1.2 MB 00:00 2026-02-17T00:47:50.004 INFO:teuthology.orchestra.run.trial092.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 3.4 MB/s | 35 kB 00:00 2026-02-17T00:47:50.040 INFO:teuthology.orchestra.run.trial092.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 172 MB/s | 6.1 MB 00:00 2026-02-17T00:47:50.058 INFO:teuthology.orchestra.run.trial092.stdout:(45/96): python3-babel-2.9.1-2.el9.noarch.rpm 44 MB/s | 6.0 MB 00:00 2026-02-17T00:47:50.059 INFO:teuthology.orchestra.run.trial092.stdout:(46/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 23 MB/s | 442 kB 00:00 2026-02-17T00:47:50.068 INFO:teuthology.orchestra.run.trial092.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 7.7 MB/s | 77 kB 00:00 2026-02-17T00:47:50.070 INFO:teuthology.orchestra.run.trial092.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 24 MB/s | 267 kB 00:00 2026-02-17T00:47:50.078 INFO:teuthology.orchestra.run.trial092.stdout:(49/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 15 MB/s | 159 kB 00:00 2026-02-17T00:47:50.082 INFO:teuthology.orchestra.run.trial092.stdout:(50/96): python3-pyasn1-modules-0.4.8-6.el9.noa 24 MB/s | 279 kB 00:00 2026-02-17T00:47:50.088 INFO:teuthology.orchestra.run.trial092.stdout:(51/96): python3-requests-oauthlib-1.3.0-12.el9 5.6 MB/s | 54 kB 00:00 2026-02-17T00:47:50.097 INFO:teuthology.orchestra.run.trial092.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 4.4 MB/s | 42 kB 00:00 2026-02-17T00:47:50.107 INFO:teuthology.orchestra.run.trial092.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 18 MB/s | 189 kB 00:00 2026-02-17T00:47:50.117 INFO:teuthology.orchestra.run.trial092.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 9.3 MB/s | 90 kB 00:00 2026-02-17T00:47:50.183 INFO:teuthology.orchestra.run.trial092.stdout:(55/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 190 MB/s | 19 MB 00:00 2026-02-17T00:47:50.368 INFO:teuthology.orchestra.run.trial092.stdout:(56/96): lua-devel-5.4.4-4.el9.x86_64.rpm 89 kB/s | 22 kB 00:00 2026-02-17T00:47:50.672 INFO:teuthology.orchestra.run.trial092.stdout:(57/96): python3-cryptography-36.0.1-5.el9.x86_ 710 kB/s | 1.2 MB 00:01 2026-02-17T00:47:50.692 INFO:teuthology.orchestra.run.trial092.stdout:(58/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.7 MB/s | 551 kB 00:00 2026-02-17T00:47:50.744 INFO:teuthology.orchestra.run.trial092.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2026-02-17T00:47:50.818 INFO:teuthology.orchestra.run.trial092.stdout:(60/96): protobuf-compiler-3.14.0-17.el9.x86_64 1.3 MB/s | 862 kB 00:00 2026-02-17T00:47:50.821 INFO:teuthology.orchestra.run.trial092.stdout:(61/96): python3-asyncssh-2.13.2-5.el9.noarch.r 6.9 MB/s | 548 kB 00:00 2026-02-17T00:47:50.839 INFO:teuthology.orchestra.run.trial092.stdout:(62/96): grpc-data-1.46.7-10.el9.noarch.rpm 116 kB/s | 19 kB 00:00 2026-02-17T00:47:50.874 INFO:teuthology.orchestra.run.trial092.stdout:(63/96): python3-backports-tarfile-1.2.0-1.el9. 1.1 MB/s | 60 kB 00:00 2026-02-17T00:47:50.935 INFO:teuthology.orchestra.run.trial092.stdout:(64/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 451 kB/s | 43 kB 00:00 2026-02-17T00:47:50.940 INFO:teuthology.orchestra.run.trial092.stdout:(65/96): python3-cachetools-4.2.4-1.el9.noarch. 488 kB/s | 32 kB 00:00 2026-02-17T00:47:50.984 INFO:teuthology.orchestra.run.trial092.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 290 kB/s | 14 kB 00:00 2026-02-17T00:47:50.987 INFO:teuthology.orchestra.run.trial092.stdout:(67/96): python3-autocommand-2.2.2-8.el9.noarch 174 kB/s | 29 kB 00:00 2026-02-17T00:47:50.996 INFO:teuthology.orchestra.run.trial092.stdout:(68/96): python3-cheroot-10.0.1-4.el9.noarch.rp 3.0 MB/s | 173 kB 00:00 2026-02-17T00:47:51.114 INFO:teuthology.orchestra.run.trial092.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 17 MB/s | 2.0 MB 00:00 2026-02-17T00:47:51.126 INFO:teuthology.orchestra.run.trial092.stdout:(70/96): python3-cherrypy-18.6.1-2.el9.noarch.r 2.5 MB/s | 358 kB 00:00 2026-02-17T00:47:51.145 INFO:teuthology.orchestra.run.trial092.stdout:(71/96): python3-google-auth-2.45.0-1.el9.noarc 1.6 MB/s | 254 kB 00:00 2026-02-17T00:47:51.156 INFO:teuthology.orchestra.run.trial092.stdout:(72/96): python3-grpcio-tools-1.46.7-10.el9.x86 3.4 MB/s | 144 kB 00:00 2026-02-17T00:47:51.180 INFO:teuthology.orchestra.run.trial092.stdout:(73/96): python3-influxdb-5.3.1-1.el9.noarch.rp 2.5 MB/s | 139 kB 00:00 2026-02-17T00:47:51.191 INFO:teuthology.orchestra.run.trial092.stdout:(74/96): python3-isodate-0.6.1-3.el9.noarch.rpm 1.2 MB/s | 56 kB 00:00 2026-02-17T00:47:51.199 INFO:teuthology.orchestra.run.trial092.stdout:(75/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 249 kB/s | 11 kB 00:00 2026-02-17T00:47:51.219 INFO:teuthology.orchestra.run.trial092.stdout:(76/96): python3-jaraco-classes-3.2.1-5.el9.noa 458 kB/s | 18 kB 00:00 2026-02-17T00:47:51.230 INFO:teuthology.orchestra.run.trial092.stdout:(77/96): python3-jaraco-collections-3.0.0-8.el9 589 kB/s | 23 kB 00:00 2026-02-17T00:47:51.244 INFO:teuthology.orchestra.run.trial092.stdout:(78/96): python3-jaraco-context-6.0.1-3.el9.noa 433 kB/s | 20 kB 00:00 2026-02-17T00:47:51.257 INFO:teuthology.orchestra.run.trial092.stdout:(79/96): python3-jaraco-functools-3.5.0-2.el9.n 502 kB/s | 19 kB 00:00 2026-02-17T00:47:51.270 INFO:teuthology.orchestra.run.trial092.stdout:(80/96): python3-jaraco-text-4.0.0-2.el9.noarch 665 kB/s | 26 kB 00:00 2026-02-17T00:47:51.337 INFO:teuthology.orchestra.run.trial092.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2026-02-17T00:47:51.353 INFO:teuthology.orchestra.run.trial092.stdout:(82/96): python3-more-itertools-8.12.0-2.el9.no 828 kB/s | 79 kB 00:00 2026-02-17T00:47:51.365 INFO:teuthology.orchestra.run.trial092.stdout:(83/96): python3-kubernetes-26.1.0-3.el9.noarch 8.5 MB/s | 1.0 MB 00:00 2026-02-17T00:47:51.379 INFO:teuthology.orchestra.run.trial092.stdout:(84/96): python3-natsort-7.1.1-5.el9.noarch.rpm 1.3 MB/s | 58 kB 00:00 2026-02-17T00:47:51.401 INFO:teuthology.orchestra.run.trial092.stdout:(85/96): python3-portend-3.1.0-2.el9.noarch.rpm 340 kB/s | 16 kB 00:00 2026-02-17T00:47:51.412 INFO:teuthology.orchestra.run.trial092.stdout:(86/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.9 MB/s | 90 kB 00:00 2026-02-17T00:47:51.419 INFO:teuthology.orchestra.run.trial092.stdout:(87/96): python3-repoze-lru-0.7-16.el9.noarch.r 772 kB/s | 31 kB 00:00 2026-02-17T00:47:51.450 INFO:teuthology.orchestra.run.trial092.stdout:(88/96): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2026-02-17T00:47:51.461 INFO:teuthology.orchestra.run.trial092.stdout:(89/96): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2026-02-17T00:47:51.479 INFO:teuthology.orchestra.run.trial092.stdout:(90/96): python3-saml-1.16.0-1.el9.noarch.rpm 2.0 MB/s | 125 kB 00:00 2026-02-17T00:47:51.494 INFO:teuthology.orchestra.run.trial092.stdout:(91/96): python3-tempora-5.0.0-2.el9.noarch.rpm 812 kB/s | 36 kB 00:00 2026-02-17T00:47:51.511 INFO:teuthology.orchestra.run.trial092.stdout:(92/96): python3-typing-extensions-4.15.0-1.el9 1.7 MB/s | 86 kB 00:00 2026-02-17T00:47:51.529 INFO:teuthology.orchestra.run.trial092.stdout:(93/96): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2026-02-17T00:47:51.542 INFO:teuthology.orchestra.run.trial092.stdout:(94/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.0 MB/s | 48 kB 00:00 2026-02-17T00:47:51.552 INFO:teuthology.orchestra.run.trial092.stdout:(95/96): python3-xmltodict-0.12.0-15.el9.noarch 548 kB/s | 22 kB 00:00 2026-02-17T00:47:51.577 INFO:teuthology.orchestra.run.trial092.stdout:(96/96): python3-zc-lockfile-2.0-10.el9.noarch. 415 kB/s | 20 kB 00:00 2026-02-17T00:47:51.583 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:47:51.584 INFO:teuthology.orchestra.run.trial092.stdout:Total 23 MB/s | 158 MB 00:06 2026-02-17T00:47:51.999 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T00:47:52.036 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T00:47:52.037 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T00:47:52.634 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T00:47:52.634 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T00:47:53.255 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T00:47:53.257 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-17T00:47:53.261 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-17T00:47:53.282 INFO:teuthology.orchestra.run.trial092.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-17T00:47:53.316 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-17T00:47:53.323 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-17T00:47:53.325 INFO:teuthology.orchestra.run.trial092.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-17T00:47:53.329 INFO:teuthology.orchestra.run.trial092.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-17T00:47:53.353 INFO:teuthology.orchestra.run.trial092.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-17T00:47:53.366 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-17T00:47:53.369 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-17T00:47:53.375 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-17T00:47:53.377 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-17T00:47:53.388 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-17T00:47:53.394 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-17T00:47:53.419 INFO:teuthology.orchestra.run.trial092.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-17T00:47:53.422 INFO:teuthology.orchestra.run.trial092.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-17T00:47:53.473 INFO:teuthology.orchestra.run.trial092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-17T00:47:53.486 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-17T00:47:53.488 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-17T00:47:53.493 INFO:teuthology.orchestra.run.trial092.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-17T00:47:53.498 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-17T00:47:53.503 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-17T00:47:53.506 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-17T00:47:53.521 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-17T00:47:53.525 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-17T00:47:53.530 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-17T00:47:53.541 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-17T00:47:53.550 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-17T00:47:53.556 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-17T00:47:53.576 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-17T00:47:53.587 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-17T00:47:53.603 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-17T00:47:53.608 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-17T00:47:53.615 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-17T00:47:53.656 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-17T00:47:53.984 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-17T00:47:53.994 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-17T00:47:53.998 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-17T00:47:54.003 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-17T00:47:54.005 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-17T00:47:54.033 INFO:teuthology.orchestra.run.trial092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-17T00:47:54.077 INFO:teuthology.orchestra.run.trial092.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-17T00:47:54.085 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-17T00:47:54.091 INFO:teuthology.orchestra.run.trial092.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-17T00:47:54.094 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-17T00:47:54.100 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-17T00:47:54.104 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-17T00:47:54.111 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-17T00:47:54.114 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-17T00:47:54.142 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-17T00:47:54.152 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-17T00:47:54.158 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-17T00:47:54.165 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-17T00:47:54.199 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-17T00:47:54.425 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 55/96 2026-02-17T00:47:54.448 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-17T00:47:54.452 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-17T00:47:54.511 INFO:teuthology.orchestra.run.trial092.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-17T00:47:54.513 INFO:teuthology.orchestra.run.trial092.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-17T00:47:54.534 INFO:teuthology.orchestra.run.trial092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-17T00:47:54.862 INFO:teuthology.orchestra.run.trial092.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-17T00:47:54.935 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-17T00:47:55.612 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-17T00:47:55.630 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-17T00:47:55.640 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-17T00:47:55.647 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-17T00:47:55.660 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-17T00:47:55.676 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-17T00:47:55.752 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-17T00:47:55.760 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-17T00:47:55.784 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-17T00:47:55.814 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-17T00:47:55.864 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-17T00:47:55.870 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-17T00:47:55.874 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-17T00:47:55.875 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-17T00:47:55.894 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T00:47:55.894 INFO:teuthology.orchestra.run.trial092.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T00:47:55.894 INFO:teuthology.orchestra.run.trial092.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T00:47:55.894 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:55.902 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T00:47:55.928 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-17T00:47:55.929 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T00:47:55.929 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:55.965 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-17T00:47:56.596 INFO:teuthology.orchestra.run.trial092.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 79/96 2026-02-17T00:47:57.371 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-osd-classic-2:20.3.0-5225.g03ef619e.el9.x86_6 80/96 2026-02-17T00:47:57.434 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-osd-crimson-2:20.3.0-5225.g03ef619e.el9.x86_6 81/96 2026-02-17T00:47:57.436 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-volume-2:20.3.0-5225.g03ef619e.el9.noarch 82/96 2026-02-17T00:47:57.450 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-volume-2:20.3.0-5225.g03ef619e.el9.noarch 82/96 2026-02-17T00:47:57.450 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:47:57.451 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T00:47:57.451 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:57.461 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-osd-2:20.3.0-5225.g03ef619e.el9.x86_64 83/96 2026-02-17T00:47:57.484 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-osd-2:20.3.0-5225.g03ef619e.el9.x86_64 83/96 2026-02-17T00:47:57.484 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:47:57.484 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T00:47:57.484 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T00:47:57.484 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T00:47:57.484 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:47:57.540 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: cephadm-2:20.3.0-5225.g03ef619e.el9.noarch 84/96 2026-02-17T00:47:57.542 INFO:teuthology.orchestra.run.trial092.stdout: Installing : cephadm-2:20.3.0-5225.g03ef619e.el9.noarch 84/96 2026-02-17T00:47:57.551 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5225.g03ef619e.el9 85/96 2026-02-17T00:47:57.575 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5225.g03ef619e.el 86/96 2026-02-17T00:47:57.576 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5225.g03ef619e.el9.noarc 87/96 2026-02-17T00:48:00.507 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5225.g03ef619e.el9.noarc 87/96 2026-02-17T00:48:00.514 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5225.g03ef619e.el9.noa 88/96 2026-02-17T00:48:00.974 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5225.g03ef619e.el9.noa 88/96 2026-02-17T00:48:00.975 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5225.g03ef6 89/96 2026-02-17T00:48:00.988 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5225.g03ef6 89/96 2026-02-17T00:48:00.988 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5225.g03ef619e.el9.noa 90/96 2026-02-17T00:48:01.049 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5225.g03ef619e.el9.noa 90/96 2026-02-17T00:48:01.091 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5225.g03ef619e.el9. 91/96 2026-02-17T00:48:01.092 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-2:20.3.0-5225.g03ef619e.el9.x86_64 92/96 2026-02-17T00:48:01.113 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5225.g03ef619e.el9.x86_64 92/96 2026-02-17T00:48:01.113 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:48:01.113 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T00:48:01.113 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T00:48:01.113 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T00:48:01.113 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:01.124 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-rook-2:20.3.0-5225.g03ef619e.el9.noarch 93/96 2026-02-17T00:48:01.348 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5225.g03ef619e.el9.noarch 93/96 2026-02-17T00:48:01.349 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mon-2:20.3.0-5225.g03ef619e.el9.x86_64 94/96 2026-02-17T00:48:01.371 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mon-2:20.3.0-5225.g03ef619e.el9.x86_64 94/96 2026-02-17T00:48:01.371 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:48:01.371 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T00:48:01.371 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T00:48:01.371 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T00:48:01.371 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:01.469 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mds-2:20.3.0-5225.g03ef619e.el9.x86_64 95/96 2026-02-17T00:48:01.491 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mds-2:20.3.0-5225.g03ef619e.el9.x86_64 95/96 2026-02-17T00:48:01.491 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:48:01.491 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T00:48:01.491 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T00:48:01.491 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T00:48:01.491 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:01.492 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-2:20.3.0-5225.g03ef619e.el9.x86_64 96/96 2026-02-17T00:48:01.499 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5225.g03ef619e.el9.x86_6 96/96 2026-02-17T00:48:01.523 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5225.g03ef619e.el9.x86_6 96/96 2026-02-17T00:48:02.366 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-2:20.3.0-5225.g03ef619e.el9.x86_64 96/96 2026-02-17T00:48:02.366 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-2:20.3.0-5225.g03ef619e.el9.x86_64 1/96 2026-02-17T00:48:02.366 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mds-2:20.3.0-5225.g03ef619e.el9.x86_64 2/96 2026-02-17T00:48:02.366 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-2:20.3.0-5225.g03ef619e.el9.x86_64 3/96 2026-02-17T00:48:02.366 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mon-2:20.3.0-5225.g03ef619e.el9.x86_64 4/96 2026-02-17T00:48:02.366 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-osd-2:20.3.0-5225.g03ef619e.el9.x86_64 5/96 2026-02-17T00:48:02.366 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-osd-classic-2:20.3.0-5225.g03ef619e.el9.x86_6 6/96 2026-02-17T00:48:02.366 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5225.g03ef619e.el9.x86_6 7/96 2026-02-17T00:48:02.367 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5225.g03ef619e.el 8/96 2026-02-17T00:48:02.367 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5225.g03ef619e.el9.noarc 9/96 2026-02-17T00:48:02.367 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5225.g03ef619e.el9.noa 10/96 2026-02-17T00:48:02.367 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5225.g03ef6 11/96 2026-02-17T00:48:02.367 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5225.g03ef619e.el9.noa 12/96 2026-02-17T00:48:02.367 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5225.g03ef619e.el9. 13/96 2026-02-17T00:48:02.367 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5225.g03ef619e.el9.noarch 14/96 2026-02-17T00:48:02.367 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5225.g03ef619e.el9 15/96 2026-02-17T00:48:02.367 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-volume-2:20.3.0-5225.g03ef619e.el9.noarch 16/96 2026-02-17T00:48:02.367 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : cephadm-2:20.3.0-5225.g03ef619e.el9.noarch 17/96 2026-02-17T00:48:02.367 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 18/96 2026-02-17T00:48:02.368 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-17T00:48:02.368 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-17T00:48:02.368 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-17T00:48:02.368 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-17T00:48:02.368 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-17T00:48:02.368 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-17T00:48:02.368 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-17T00:48:02.368 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-17T00:48:02.368 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-17T00:48:02.368 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-17T00:48:02.368 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-17T00:48:02.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-17T00:48:02.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-17T00:48:02.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-17T00:48:02.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-17T00:48:02.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-17T00:48:02.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-17T00:48:02.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-17T00:48:02.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-17T00:48:02.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-17T00:48:02.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-17T00:48:02.369 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 40/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-17T00:48:02.370 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-17T00:48:02.371 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-17T00:48:02.371 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-17T00:48:02.371 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-17T00:48:02.371 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-17T00:48:02.371 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-17T00:48:02.371 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-17T00:48:02.371 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-17T00:48:02.371 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-17T00:48:02.371 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-17T00:48:02.371 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-17T00:48:02.371 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-17T00:48:02.372 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-17T00:48:02.372 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-17T00:48:02.372 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-17T00:48:02.372 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-17T00:48:02.372 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-17T00:48:02.372 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-17T00:48:02.372 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-17T00:48:02.372 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-17T00:48:02.372 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-17T00:48:02.372 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-17T00:48:02.372 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-17T00:48:02.373 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-17T00:48:02.373 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-17T00:48:02.373 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-17T00:48:02.373 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-17T00:48:02.373 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-17T00:48:02.373 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-17T00:48:02.373 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-17T00:48:02.373 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-17T00:48:02.373 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-17T00:48:02.373 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-17T00:48:02.373 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-17T00:48:02.374 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-17T00:48:02.374 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-17T00:48:02.374 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-17T00:48:02.374 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-17T00:48:02.374 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-17T00:48:02.374 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-17T00:48:02.374 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-17T00:48:02.374 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-17T00:48:02.374 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-17T00:48:02.374 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-17T00:48:02.428 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-17T00:48:02.428 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:02.428 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T00:48:02.429 INFO:teuthology.orchestra.run.trial092.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T00:48:02.429 INFO:teuthology.orchestra.run.trial092.stdout: ceph-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:02.429 INFO:teuthology.orchestra.run.trial092.stdout: ceph-grafana-dashboards-2:20.3.0-5225.g03ef619e.el9.noarch 2026-02-17T00:48:02.429 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mds-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:02.429 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:02.429 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-cephadm-2:20.3.0-5225.g03ef619e.el9.noarch 2026-02-17T00:48:02.429 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-dashboard-2:20.3.0-5225.g03ef619e.el9.noarch 2026-02-17T00:48:02.429 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5225.g03ef619e.el9.noarch 2026-02-17T00:48:02.429 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-k8sevents-2:20.3.0-5225.g03ef619e.el9.noarch 2026-02-17T00:48:02.429 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-modules-core-2:20.3.0-5225.g03ef619e.el9.noarch 2026-02-17T00:48:02.429 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-rook-2:20.3.0-5225.g03ef619e.el9.noarch 2026-02-17T00:48:02.430 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mon-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:02.430 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:02.430 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-classic-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:02.430 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-crimson-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:02.430 INFO:teuthology.orchestra.run.trial092.stdout: ceph-prometheus-alerts-2:20.3.0-5225.g03ef619e.el9.noarch 2026-02-17T00:48:02.430 INFO:teuthology.orchestra.run.trial092.stdout: ceph-volume-2:20.3.0-5225.g03ef619e.el9.noarch 2026-02-17T00:48:02.430 INFO:teuthology.orchestra.run.trial092.stdout: cephadm-2:20.3.0-5225.g03ef619e.el9.noarch 2026-02-17T00:48:02.430 INFO:teuthology.orchestra.run.trial092.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T00:48:02.430 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T00:48:02.430 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T00:48:02.431 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T00:48:02.431 INFO:teuthology.orchestra.run.trial092.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T00:48:02.431 INFO:teuthology.orchestra.run.trial092.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T00:48:02.431 INFO:teuthology.orchestra.run.trial092.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T00:48:02.431 INFO:teuthology.orchestra.run.trial092.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T00:48:02.431 INFO:teuthology.orchestra.run.trial092.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T00:48:02.431 INFO:teuthology.orchestra.run.trial092.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T00:48:02.431 INFO:teuthology.orchestra.run.trial092.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T00:48:02.431 INFO:teuthology.orchestra.run.trial092.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T00:48:02.431 INFO:teuthology.orchestra.run.trial092.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T00:48:02.431 INFO:teuthology.orchestra.run.trial092.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T00:48:02.432 INFO:teuthology.orchestra.run.trial092.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T00:48:02.432 INFO:teuthology.orchestra.run.trial092.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T00:48:02.432 INFO:teuthology.orchestra.run.trial092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T00:48:02.432 INFO:teuthology.orchestra.run.trial092.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T00:48:02.432 INFO:teuthology.orchestra.run.trial092.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T00:48:02.432 INFO:teuthology.orchestra.run.trial092.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T00:48:02.432 INFO:teuthology.orchestra.run.trial092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T00:48:02.432 INFO:teuthology.orchestra.run.trial092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T00:48:02.432 INFO:teuthology.orchestra.run.trial092.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T00:48:02.432 INFO:teuthology.orchestra.run.trial092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T00:48:02.433 INFO:teuthology.orchestra.run.trial092.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T00:48:02.433 INFO:teuthology.orchestra.run.trial092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T00:48:02.433 INFO:teuthology.orchestra.run.trial092.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T00:48:02.433 INFO:teuthology.orchestra.run.trial092.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T00:48:02.433 INFO:teuthology.orchestra.run.trial092.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T00:48:02.433 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T00:48:02.433 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T00:48:02.433 INFO:teuthology.orchestra.run.trial092.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T00:48:02.433 INFO:teuthology.orchestra.run.trial092.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T00:48:02.433 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T00:48:02.433 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T00:48:02.434 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T00:48:02.434 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T00:48:02.434 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T00:48:02.434 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T00:48:02.434 INFO:teuthology.orchestra.run.trial092.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T00:48:02.434 INFO:teuthology.orchestra.run.trial092.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-17T00:48:02.434 INFO:teuthology.orchestra.run.trial092.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T00:48:02.434 INFO:teuthology.orchestra.run.trial092.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T00:48:02.434 INFO:teuthology.orchestra.run.trial092.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T00:48:02.434 INFO:teuthology.orchestra.run.trial092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T00:48:02.434 INFO:teuthology.orchestra.run.trial092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T00:48:02.435 INFO:teuthology.orchestra.run.trial092.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T00:48:02.435 INFO:teuthology.orchestra.run.trial092.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T00:48:02.435 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T00:48:02.435 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T00:48:02.435 INFO:teuthology.orchestra.run.trial092.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T00:48:02.435 INFO:teuthology.orchestra.run.trial092.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T00:48:02.435 INFO:teuthology.orchestra.run.trial092.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T00:48:02.435 INFO:teuthology.orchestra.run.trial092.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T00:48:02.435 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T00:48:02.435 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T00:48:02.435 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T00:48:02.436 INFO:teuthology.orchestra.run.trial092.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T00:48:02.436 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T00:48:02.436 INFO:teuthology.orchestra.run.trial092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T00:48:02.436 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T00:48:02.436 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T00:48:02.436 INFO:teuthology.orchestra.run.trial092.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T00:48:02.436 INFO:teuthology.orchestra.run.trial092.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T00:48:02.436 INFO:teuthology.orchestra.run.trial092.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T00:48:02.436 INFO:teuthology.orchestra.run.trial092.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T00:48:02.436 INFO:teuthology.orchestra.run.trial092.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T00:48:02.436 INFO:teuthology.orchestra.run.trial092.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T00:48:02.437 INFO:teuthology.orchestra.run.trial092.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T00:48:02.437 INFO:teuthology.orchestra.run.trial092.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T00:48:02.437 INFO:teuthology.orchestra.run.trial092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T00:48:02.437 INFO:teuthology.orchestra.run.trial092.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T00:48:02.437 INFO:teuthology.orchestra.run.trial092.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T00:48:02.437 INFO:teuthology.orchestra.run.trial092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T00:48:02.437 INFO:teuthology.orchestra.run.trial092.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T00:48:02.437 INFO:teuthology.orchestra.run.trial092.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T00:48:02.437 INFO:teuthology.orchestra.run.trial092.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T00:48:02.437 INFO:teuthology.orchestra.run.trial092.stdout: zip-3.0-35.el9.x86_64 2026-02-17T00:48:02.437 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:02.438 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:02.490 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-base 2026-02-17T00:48:02.806 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:02.869 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-base-2:20.3.0-5225.g03ef619e.el9.x86_64 is already installed. 2026-02-17T00:48:02.887 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:02.887 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:02.887 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:02.908 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install cephadm 2026-02-17T00:48:03.216 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:03.280 INFO:teuthology.orchestra.run.trial092.stdout:Package cephadm-2:20.3.0-5225.g03ef619e.el9.noarch is already installed. 2026-02-17T00:48:03.297 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:03.298 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:03.298 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:03.318 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T00:48:03.626 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:03.709 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:03.710 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:03.710 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T00:48:03.710 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:03.710 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T00:48:03.710 INFO:teuthology.orchestra.run.trial092.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 147 k 2026-02-17T00:48:03.711 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:03.711 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T00:48:03.711 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:03.711 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T00:48:03.711 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:03.711 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 147 k 2026-02-17T00:48:03.711 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 419 k 2026-02-17T00:48:03.711 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T00:48:03.815 INFO:teuthology.orchestra.run.trial092.stdout:ceph-immutable-object-cache-20.3.0-5225.g03ef61 1.4 MB/s | 147 kB 00:00 2026-02-17T00:48:03.816 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:48:03.817 INFO:teuthology.orchestra.run.trial092.stdout:Total 1.4 MB/s | 147 kB 00:00 2026-02-17T00:48:03.817 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T00:48:03.820 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T00:48:03.821 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T00:48:03.852 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T00:48:03.852 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T00:48:03.907 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T00:48:03.908 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5225.g03ef619e. 1/1 2026-02-17T00:48:03.931 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5225.g03ef619e. 1/1 2026-02-17T00:48:03.931 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:48:03.931 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T00:48:03.931 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:04.241 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5225.g03ef619e. 1/1 2026-02-17T00:48:04.241 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:04.242 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T00:48:04.242 INFO:teuthology.orchestra.run.trial092.stdout: ceph-immutable-object-cache-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:04.242 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:04.242 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:04.269 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mgr 2026-02-17T00:48:04.577 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:04.641 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-mgr-2:20.3.0-5225.g03ef619e.el9.x86_64 is already installed. 2026-02-17T00:48:04.659 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:04.659 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:04.659 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:04.680 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T00:48:04.995 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:05.058 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-mgr-dashboard-2:20.3.0-5225.g03ef619e.el9.noarch is already installed. 2026-02-17T00:48:05.076 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:05.077 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:05.077 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:05.099 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T00:48:05.406 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:05.470 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5225.g03ef619e.el9.noarch is already installed. 2026-02-17T00:48:05.487 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:05.487 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:05.488 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:05.508 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mgr-rook 2026-02-17T00:48:05.819 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:42 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:05.882 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-mgr-rook-2:20.3.0-5225.g03ef619e.el9.noarch is already installed. 2026-02-17T00:48:05.899 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:05.900 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:05.900 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:05.921 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T00:48:06.229 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:06.294 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-mgr-cephadm-2:20.3.0-5225.g03ef619e.el9.noarch is already installed. 2026-02-17T00:48:06.311 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:06.311 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:06.312 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:06.334 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-osd 2026-02-17T00:48:06.639 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:43 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:06.705 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-osd-2:20.3.0-5225.g03ef619e.el9.x86_64 is already installed. 2026-02-17T00:48:06.722 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:06.723 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:06.723 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:06.744 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-osd-classic 2026-02-17T00:48:07.052 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:07.115 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-osd-classic-2:20.3.0-5225.g03ef619e.el9.x86_64 is already installed. 2026-02-17T00:48:07.133 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:07.133 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:07.134 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:07.155 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-fuse 2026-02-17T00:48:07.462 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:44 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:07.547 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:07.547 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:07.547 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T00:48:07.547 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:07.547 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T00:48:07.547 INFO:teuthology.orchestra.run.trial092.stdout: ceph-fuse x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 987 k 2026-02-17T00:48:07.547 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:07.547 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T00:48:07.548 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:07.548 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T00:48:07.548 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:07.548 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 987 k 2026-02-17T00:48:07.548 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 2.9 M 2026-02-17T00:48:07.548 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T00:48:07.679 INFO:teuthology.orchestra.run.trial092.stdout:ceph-fuse-20.3.0-5225.g03ef619e.el9.x86_64.rpm 7.3 MB/s | 987 kB 00:00 2026-02-17T00:48:07.679 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:48:07.679 INFO:teuthology.orchestra.run.trial092.stdout:Total 7.3 MB/s | 987 kB 00:00 2026-02-17T00:48:07.679 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T00:48:07.684 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T00:48:07.684 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T00:48:07.718 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T00:48:07.719 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T00:48:07.811 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T00:48:07.829 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-fuse-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:08.040 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:08.098 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-fuse-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:08.098 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:08.098 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T00:48:08.098 INFO:teuthology.orchestra.run.trial092.stdout: ceph-fuse-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:08.098 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:08.098 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:08.126 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-volume 2026-02-17T00:48:08.436 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:08.499 INFO:teuthology.orchestra.run.trial092.stdout:Package ceph-volume-2:20.3.0-5225.g03ef619e.el9.noarch is already installed. 2026-02-17T00:48:08.516 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:08.517 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:08.517 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:08.538 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install librados-devel 2026-02-17T00:48:08.845 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:45 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:08.926 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:08.927 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:08.927 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T00:48:08.927 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:08.927 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T00:48:08.928 INFO:teuthology.orchestra.run.trial092.stdout: librados-devel x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 123 k 2026-02-17T00:48:08.928 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:08.928 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T00:48:08.928 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:08.928 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T00:48:08.928 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:08.928 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 123 k 2026-02-17T00:48:08.928 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 437 k 2026-02-17T00:48:08.928 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T00:48:09.347 INFO:teuthology.orchestra.run.trial092.stdout:librados-devel-20.3.0-5225.g03ef619e.el9.x86_64 293 kB/s | 123 kB 00:00 2026-02-17T00:48:09.347 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:48:09.347 INFO:teuthology.orchestra.run.trial092.stdout:Total 293 kB/s | 123 kB 00:00 2026-02-17T00:48:09.347 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T00:48:09.350 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T00:48:09.351 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T00:48:09.383 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T00:48:09.383 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T00:48:09.437 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T00:48:09.454 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librados-devel-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:09.535 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librados-devel-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:09.592 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librados-devel-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:09.592 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:09.592 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T00:48:09.592 INFO:teuthology.orchestra.run.trial092.stdout: librados-devel-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:09.592 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:09.592 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:09.620 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install libcephfs2 2026-02-17T00:48:09.936 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:46 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:10.000 INFO:teuthology.orchestra.run.trial092.stdout:Package libcephfs2-2:20.3.0-5225.g03ef619e.el9.x86_64 is already installed. 2026-02-17T00:48:10.017 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:10.018 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:10.018 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:10.040 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install libcephfs-devel 2026-02-17T00:48:10.346 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:47 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:10.427 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:10.428 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:10.428 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T00:48:10.428 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:10.428 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T00:48:10.428 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-devel x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 37 k 2026-02-17T00:48:10.428 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:10.428 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T00:48:10.428 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:10.428 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T00:48:10.429 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:10.429 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 37 k 2026-02-17T00:48:10.429 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 171 k 2026-02-17T00:48:10.429 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T00:48:10.512 INFO:teuthology.orchestra.run.trial092.stdout:libcephfs-devel-20.3.0-5225.g03ef619e.el9.x86_6 445 kB/s | 37 kB 00:00 2026-02-17T00:48:10.512 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:48:10.512 INFO:teuthology.orchestra.run.trial092.stdout:Total 440 kB/s | 37 kB 00:00 2026-02-17T00:48:10.513 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T00:48:10.515 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T00:48:10.515 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T00:48:10.517 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T00:48:10.517 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T00:48:10.539 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T00:48:10.555 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephfs-devel-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:10.612 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:10.668 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephfs-devel-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:10.668 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:10.668 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T00:48:10.668 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-devel-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:10.668 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:10.668 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:10.694 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install librados2 2026-02-17T00:48:11.003 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:11.067 INFO:teuthology.orchestra.run.trial092.stdout:Package librados2-2:20.3.0-5225.g03ef619e.el9.x86_64 is already installed. 2026-02-17T00:48:11.084 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:11.085 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:11.085 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:11.106 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install librbd1 2026-02-17T00:48:11.417 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:11.481 INFO:teuthology.orchestra.run.trial092.stdout:Package librbd1-2:20.3.0-5225.g03ef619e.el9.x86_64 is already installed. 2026-02-17T00:48:11.498 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:11.499 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:11.499 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:11.520 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-rados 2026-02-17T00:48:11.830 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:48 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:11.893 INFO:teuthology.orchestra.run.trial092.stdout:Package python3-rados-2:20.3.0-5225.g03ef619e.el9.x86_64 is already installed. 2026-02-17T00:48:11.911 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:11.911 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:11.911 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:11.932 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-rgw 2026-02-17T00:48:12.244 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:12.307 INFO:teuthology.orchestra.run.trial092.stdout:Package python3-rgw-2:20.3.0-5225.g03ef619e.el9.x86_64 is already installed. 2026-02-17T00:48:12.325 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:12.326 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:12.326 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:12.347 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-cephfs 2026-02-17T00:48:12.658 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:49 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:12.723 INFO:teuthology.orchestra.run.trial092.stdout:Package python3-cephfs-2:20.3.0-5225.g03ef619e.el9.x86_64 is already installed. 2026-02-17T00:48:12.740 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:12.741 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:12.741 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:12.762 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install python3-rbd 2026-02-17T00:48:13.072 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:13.136 INFO:teuthology.orchestra.run.trial092.stdout:Package python3-rbd-2:20.3.0-5225.g03ef619e.el9.x86_64 is already installed. 2026-02-17T00:48:13.153 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:13.154 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-17T00:48:13.154 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:13.175 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install rbd-fuse 2026-02-17T00:48:13.486 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:50 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:13.568 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:13.569 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:13.569 INFO:teuthology.orchestra.run.trial092.stdout: Package Architecture Version Repository Size 2026-02-17T00:48:13.569 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:13.569 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T00:48:13.569 INFO:teuthology.orchestra.run.trial092.stdout: rbd-fuse x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 84 k 2026-02-17T00:48:13.569 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:13.569 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T00:48:13.569 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:13.570 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T00:48:13.570 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:13.570 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 84 k 2026-02-17T00:48:13.570 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 209 k 2026-02-17T00:48:13.570 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T00:48:13.668 INFO:teuthology.orchestra.run.trial092.stdout:rbd-fuse-20.3.0-5225.g03ef619e.el9.x86_64.rpm 848 kB/s | 84 kB 00:00 2026-02-17T00:48:13.669 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:48:13.669 INFO:teuthology.orchestra.run.trial092.stdout:Total 838 kB/s | 84 kB 00:00 2026-02-17T00:48:13.669 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T00:48:13.674 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T00:48:13.674 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T00:48:13.707 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T00:48:13.707 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T00:48:13.761 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T00:48:13.777 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-fuse-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:13.856 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:13.913 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-fuse-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:13.914 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:13.914 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T00:48:13.914 INFO:teuthology.orchestra.run.trial092.stdout: rbd-fuse-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:13.914 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:13.914 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:13.942 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install rbd-mirror 2026-02-17T00:48:14.258 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:51 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:14.341 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:14.341 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:14.341 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repo Size 2026-02-17T00:48:14.341 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:14.341 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T00:48:14.341 INFO:teuthology.orchestra.run.trial092.stdout: rbd-mirror x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 2.9 M 2026-02-17T00:48:14.341 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:14.342 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T00:48:14.342 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:14.342 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T00:48:14.342 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:14.342 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 2.9 M 2026-02-17T00:48:14.342 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 11 M 2026-02-17T00:48:14.342 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T00:48:14.751 INFO:teuthology.orchestra.run.trial092.stdout:rbd-mirror-20.3.0-5225.g03ef619e.el9.x86_64.rpm 7.0 MB/s | 2.9 MB 00:00 2026-02-17T00:48:14.752 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:48:14.752 INFO:teuthology.orchestra.run.trial092.stdout:Total 7.0 MB/s | 2.9 MB 00:00 2026-02-17T00:48:14.752 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T00:48:14.756 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T00:48:14.756 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T00:48:14.796 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T00:48:14.796 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T00:48:14.973 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T00:48:14.974 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-mirror-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:14.997 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:14.997 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T00:48:14.997 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T00:48:14.997 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T00:48:14.997 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T00:48:14.998 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:15.312 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-mirror-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:15.312 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:15.312 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T00:48:15.312 INFO:teuthology.orchestra.run.trial092.stdout: rbd-mirror-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:15.312 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:15.312 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:15.339 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install rbd-nbd 2026-02-17T00:48:15.649 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Feb 2026 12:47:23 AM UTC. 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout: Package Architecture Version Repository Size 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout: rbd-nbd x86_64 2:20.3.0-5225.g03ef619e.el9 ceph 173 k 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout:Install 1 Package 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 173 k 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout:Installed size: 462 k 2026-02-17T00:48:15.731 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-17T00:48:15.818 INFO:teuthology.orchestra.run.trial092.stdout:rbd-nbd-20.3.0-5225.g03ef619e.el9.x86_64.rpm 2.0 MB/s | 173 kB 00:00 2026-02-17T00:48:15.818 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-17T00:48:15.818 INFO:teuthology.orchestra.run.trial092.stdout:Total 1.9 MB/s | 173 kB 00:00 2026-02-17T00:48:15.819 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-17T00:48:15.823 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-17T00:48:15.823 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-17T00:48:15.855 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-17T00:48:15.856 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-17T00:48:15.911 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-17T00:48:15.927 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-nbd-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:16.005 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:16.062 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-nbd-2:20.3.0-5225.g03ef619e.el9.x86_64 1/1 2026-02-17T00:48:16.063 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:16.063 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-17T00:48:16.063 INFO:teuthology.orchestra.run.trial092.stdout: rbd-nbd-2:20.3.0-5225.g03ef619e.el9.x86_64 2026-02-17T00:48:16.063 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-17T00:48:16.063 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-17T00:48:16.094 DEBUG:teuthology.parallel:result is None 2026-02-17T00:48:16.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=03ef619e79a56cd363b087a5c6f19a1a09b49040 2026-02-17T00:48:16.268 DEBUG:teuthology.orchestra.run.trial092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T00:48:16.290 INFO:teuthology.orchestra.run.trial092.stdout:20.3.0-5225.g03ef619e.el9 2026-02-17T00:48:16.290 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5225.g03ef619e.el9 2026-02-17T00:48:16.291 INFO:teuthology.task.install:The correct ceph version 20.3.0-5225.g03ef619e is installed. 2026-02-17T00:48:16.293 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T00:48:16.294 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T00:48:16.294 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T00:48:16.355 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T00:48:16.356 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T00:48:16.356 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T00:48:16.419 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T00:48:16.482 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T00:48:16.483 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T00:48:16.483 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T00:48:16.546 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T00:48:16.610 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T00:48:16.610 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T00:48:16.610 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T00:48:16.674 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T00:48:16.737 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T00:48:16.764 INFO:tasks.workunit:Pulling workunits from ref 03ef619e79a56cd363b087a5c6f19a1a09b49040 2026-02-17T00:48:16.765 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T00:48:16.765 INFO:tasks.workunit:timeout=3h 2026-02-17T00:48:16.765 INFO:tasks.workunit:cleanup=True 2026-02-17T00:48:16.765 DEBUG:teuthology.orchestra.run.trial092:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T00:48:16.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T00:48:16.793 INFO:teuthology.orchestra.run.trial092.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T00:48:16.793 DEBUG:teuthology.orchestra.run.trial092:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T00:48:16.849 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T00:48:16.849 DEBUG:teuthology.orchestra.run.trial092:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T00:48:16.907 DEBUG:teuthology.orchestra.run.trial092:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 03ef619e79a56cd363b087a5c6f19a1a09b49040 2026-02-17T00:48:16.972 INFO:tasks.workunit.client.0.trial092.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr:Note: switching to '03ef619e79a56cd363b087a5c6f19a1a09b49040'. 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr: 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr: 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr: 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr: git switch -c 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr: 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr:Or undo this operation with: 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr: 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr: git switch - 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr: 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr: 2026-02-17T00:48:44.234 INFO:tasks.workunit.client.0.trial092.stderr:HEAD is now at 03ef619e79a test/test_bluefs: make a standalone test case to reproduce bug#74765 2026-02-17T00:48:44.242 DEBUG:teuthology.orchestra.run.trial092:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T00:48:44.302 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-17T00:48:44.302 DEBUG:teuthology.orchestra.run.trial092:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T00:48:44.359 INFO:tasks.workunit:Running workunits matching osd on client.0... 2026-02-17T00:48:44.360 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2026-02-17T00:48:44.361 DEBUG:teuthology.orchestra.run.trial092:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03ef619e79a56cd363b087a5c6f19a1a09b49040 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2026-02-17T00:48:44.422 INFO:tasks.workunit.client.0.trial092.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T00:48:44.448 INFO:tasks.workunit.client.0.trial092.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T00:48:44.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T00:48:44.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T00:48:44.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T00:48:44.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T00:48:44.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T00:48:44.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T00:48:44.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T00:48:44.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T00:48:44.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/bad-inc-map 2026-02-17T00:48:44.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2026-02-17T00:48:44.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2026-02-17T00:48:44.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:58709 2026-02-17T00:48:44.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:58709 2026-02-17T00:48:44.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2026-02-17T00:48:44.450 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2026-02-17T00:48:44.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=1998f9cb-d23f-4f28-8462-a971d3f0a608 --auth-supported=none ' 2026-02-17T00:48:44.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:58709 ' 2026-02-17T00:48:44.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2026-02-17T00:48:44.451 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2026-02-17T00:48:44.451 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T00:48:44.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2026-02-17T00:48:44.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2026-02-17T00:48:44.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2026-02-17T00:48:44.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/bad-inc-map 2026-02-17T00:48:44.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/bad-inc-map 2026-02-17T00:48:44.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-17T00:48:44.453 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:48:44.453 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T00:48:44.453 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:48:44.453 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:48:44.453 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:48:44.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:48:44.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:48:44.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:48:44.454 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:48:44.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:48:44.455 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:48:44.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:48:44.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:48:44.455 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:48:44.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:48:44.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:48:44.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:48:44.456 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:48:44.462 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:48:44.462 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:48:44.462 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-17T00:48:44.463 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:48:44.463 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:48:44.463 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37987 2026-02-17T00:48:44.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.37987 2026-02-17T00:48:44.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:48:44.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:48:44.464 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/bad-inc-map 2026-02-17T00:48:44.464 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T00:48:44.464 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:48:44.464 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37987 2026-02-17T00:48:44.464 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.37987 2026-02-17T00:48:44.465 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T00:48:44.465 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T00:48:44.465 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T00:48:44.465 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T00:48:44.465 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2026-02-17T00:48:44.465 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2026-02-17T00:48:44.466 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2026-02-17T00:48:44.466 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2026-02-17T00:48:44.466 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/bad-inc-map 2026-02-17T00:48:44.466 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T00:48:44.466 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T00:48:44.466 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T00:48:44.467 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/bad-inc-map/a 2026-02-17T00:48:44.467 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2026-02-17T00:48:44.473 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T00:48:44.473 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:48:44.473 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:48:44.473 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:48:44.473 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:48:44.473 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37987 2026-02-17T00:48:44.474 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37987/$cluster-$name.asok' 2026-02-17T00:48:44.474 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.37987/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T00:48:44.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T00:48:44.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T00:48:44.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:48:44.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:48:44.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T00:48:44.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T00:48:44.496 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:48:44.496 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:48:44.496 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:48:44.496 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:48:44.496 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:48:44.496 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37987 2026-02-17T00:48:44.496 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.37987/ceph-mon.a.asok 2026-02-17T00:48:44.496 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:48:44.496 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.37987/ceph-mon.a.asok config get fsid 2026-02-17T00:48:44.538 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T00:48:44.538 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:48:44.538 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:48:44.539 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T00:48:44.539 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T00:48:44.539 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:48:44.539 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:48:44.539 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:48:44.539 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:48:44.539 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:48:44.539 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37987 2026-02-17T00:48:44.540 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.37987/ceph-mon.a.asok 2026-02-17T00:48:44.540 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:48:44.540 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.37987/ceph-mon.a.asok config get mon_host 2026-02-17T00:48:44.580 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2026-02-17T00:48:44.581 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/bad-inc-map 2026-02-17T00:48:44.581 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T00:48:44.581 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T00:48:44.581 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T00:48:44.581 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/bad-inc-map/x 2026-02-17T00:48:44.581 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T00:48:44.680 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T00:48:44.680 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:48:44.680 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:48:44.680 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:48:44.680 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:48:44.680 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37987 2026-02-17T00:48:44.680 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37987/$cluster-$name.asok' 2026-02-17T00:48:44.680 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:48:44.681 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.37987/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/0 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=1998f9cb-d23f-4f28-8462-a971d3f0a608 --auth-supported=none --mon-host=127.0.0.1:58709 ' 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:48:44.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T00:48:44.696 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:48:44.696 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:48:44.696 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:48:44.696 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:48:44.696 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:48:44.696 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37987 2026-02-17T00:48:44.696 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37987/$cluster-$name.asok' 2026-02-17T00:48:44.696 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37987/$cluster-$name.asok' 2026-02-17T00:48:44.696 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:48:44.696 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/0 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c4e27edd-f5a6-4012-9578-03d45e110eb7 2026-02-17T00:48:44.697 INFO:tasks.workunit.client.0.trial092.stdout:add osd0 c4e27edd-f5a6-4012-9578-03d45e110eb7 2026-02-17T00:48:44.698 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 c4e27edd-f5a6-4012-9578-03d45e110eb7' 2026-02-17T00:48:44.698 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:48:44.706 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDsupNpL/NDKhAAZlE6bd4DWZAj40yr7QvHAA== 2026-02-17T00:48:44.706 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDsupNpL/NDKhAAZlE6bd4DWZAj40yr7QvHAA=="}' 2026-02-17T00:48:44.706 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c4e27edd-f5a6-4012-9578-03d45e110eb7 -i td/bad-inc-map/0/new.json 2026-02-17T00:48:44.806 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:48:44.813 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/0/new.json 2026-02-17T00:48:44.814 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=1998f9cb-d23f-4f28-8462-a971d3f0a608 --auth-supported=none --mon-host=127.0.0.1:58709 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37987/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDsupNpL/NDKhAAZlE6bd4DWZAj40yr7QvHAA== --osd-uuid c4e27edd-f5a6-4012-9578-03d45e110eb7 2026-02-17T00:48:44.829 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:44.831+0000 7fbff602d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:44.830 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:44.832+0000 7fbff602d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:44.831 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:44.833+0000 7fbff602d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:44.831 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:44.834+0000 7fbff602d780 -1 bdev(0x418cc00 td/bad-inc-map/0/block) open stat got: (1) Operation not permitted 2026-02-17T00:48:44.832 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:44.834+0000 7fbff602d780 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2026-02-17T00:48:45.238 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/0/keyring 2026-02-17T00:48:45.238 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:48:45.239 INFO:tasks.workunit.client.0.trial092.stdout:adding osd0 key to auth repository 2026-02-17T00:48:45.239 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T00:48:45.239 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:48:45.338 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:48:45.339 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T00:48:45.339 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=1998f9cb-d23f-4f28-8462-a971d3f0a608 --auth-supported=none --mon-host=127.0.0.1:58709 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37987/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:48:45.339 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:48:45.339 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:48:45.339 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:48:45.352 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:45.354+0000 7f5b7662f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:45.353 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:45.355+0000 7f5b7662f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:45.354 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:45.356+0000 7f5b7662f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:45.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T00:48:45.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:48:45.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:48:45.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:48:45.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:48:45.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:48:45.434 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:48:45.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:48:45.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:48:45.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:48:45.529 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:48:45.567 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:45.568+0000 7f5b7662f780 -1 Falling back to public interface 2026-02-17T00:48:45.926 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:45.928+0000 7f5b7662f780 -1 osd.0 0 log_to_monitors true 2026-02-17T00:48:46.531 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:48:46.531 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:48:46.531 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:48:46.532 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:48:46.532 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:48:46.532 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:48:46.623 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2758485944,v1:127.0.0.1:6801/2758485944] [v2:127.0.0.1:6802/2758485944,v1:127.0.0.1:6803/2758485944] exists,up c4e27edd-f5a6-4012-9578-03d45e110eb7 2026-02-17T00:48:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:48:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:48:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:48:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2026-02-17T00:48:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-17T00:48:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:48:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T00:48:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:48:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/1 2026-02-17T00:48:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=1998f9cb-d23f-4f28-8462-a971d3f0a608 --auth-supported=none --mon-host=127.0.0.1:58709 ' 2026-02-17T00:48:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:48:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:48:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:48:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2026-02-17T00:48:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2026-02-17T00:48:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:48:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:48:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T00:48:46.629 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:48:46.630 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:48:46.630 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:48:46.630 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:48:46.630 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:48:46.630 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37987 2026-02-17T00:48:46.630 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37987/$cluster-$name.asok' 2026-02-17T00:48:46.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37987/$cluster-$name.asok' 2026-02-17T00:48:46.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:48:46.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:48:46.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:48:46.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T00:48:46.631 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T00:48:46.631 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:48:46.631 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:48:46.631 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:48:46.631 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:48:46.631 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:48:46.631 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:48:46.631 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/1 2026-02-17T00:48:46.631 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:48:46.631 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=57f6ed59-c7b0-43fb-a21e-fe3398a2a288 2026-02-17T00:48:46.632 INFO:tasks.workunit.client.0.trial092.stdout:add osd1 57f6ed59-c7b0-43fb-a21e-fe3398a2a288 2026-02-17T00:48:46.632 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 57f6ed59-c7b0-43fb-a21e-fe3398a2a288' 2026-02-17T00:48:46.632 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:48:46.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDuupNpez0KJhAAPRxtKOuuI697k3ccWMhlAg== 2026-02-17T00:48:46.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDuupNpez0KJhAAPRxtKOuuI697k3ccWMhlAg=="}' 2026-02-17T00:48:46.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 57f6ed59-c7b0-43fb-a21e-fe3398a2a288 -i td/bad-inc-map/1/new.json 2026-02-17T00:48:46.735 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:48:46.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/1/new.json 2026-02-17T00:48:46.742 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=1998f9cb-d23f-4f28-8462-a971d3f0a608 --auth-supported=none --mon-host=127.0.0.1:58709 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37987/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDuupNpez0KJhAAPRxtKOuuI697k3ccWMhlAg== --osd-uuid 57f6ed59-c7b0-43fb-a21e-fe3398a2a288 2026-02-17T00:48:46.756 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:46.758+0000 7f21d522d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:46.758 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:46.760+0000 7f21d522d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:46.759 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:46.761+0000 7f21d522d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:46.759 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:46.761+0000 7f21d522d780 -1 bdev(0x2c7ec00 td/bad-inc-map/1/block) open stat got: (1) Operation not permitted 2026-02-17T00:48:46.759 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:46.761+0000 7f21d522d780 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2026-02-17T00:48:47.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/1/keyring 2026-02-17T00:48:47.187 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:48:47.187 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T00:48:47.188 INFO:tasks.workunit.client.0.trial092.stdout:adding osd1 key to auth repository 2026-02-17T00:48:47.188 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:48:47.499 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T00:48:47.499 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:48:47.499 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=1998f9cb-d23f-4f28-8462-a971d3f0a608 --auth-supported=none --mon-host=127.0.0.1:58709 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37987/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:48:47.499 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:48:47.499 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:48:47.499 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:48:47.512 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:47.514+0000 7fa26022d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:47.513 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:47.515+0000 7fa26022d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:47.514 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:47.516+0000 7fa26022d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:47.640 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:47.641+0000 7fa26022d780 -1 Falling back to public interface 2026-02-17T00:48:47.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T00:48:47.724 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:48:47.724 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:48:47.724 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:48:47.724 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:48:47.724 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:48:47.724 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:48:47.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:48:47.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:48:47.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:48:47.948 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:48:47.960 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:47.962+0000 7fa26022d780 -1 osd.1 0 log_to_monitors true 2026-02-17T00:48:48.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:48:48.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:48:48.950 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:48:48.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:48:48.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:48:48.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:48:49.175 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/542743122,v1:127.0.0.1:6811/542743122] [v2:127.0.0.1:6812/542743122,v1:127.0.0.1:6813/542743122] exists,up 57f6ed59-c7b0-43fb-a21e-fe3398a2a288 2026-02-17T00:48:49.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:48:49.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:48:49.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:48:49.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2026-02-17T00:48:49.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-17T00:48:49.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:48:49.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T00:48:49.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:48:49.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/2 2026-02-17T00:48:49.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=1998f9cb-d23f-4f28-8462-a971d3f0a608 --auth-supported=none --mon-host=127.0.0.1:58709 ' 2026-02-17T00:48:49.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:48:49.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:48:49.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:48:49.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2026-02-17T00:48:49.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2026-02-17T00:48:49.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:48:49.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:48:49.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T00:48:49.181 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:48:49.181 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:48:49.181 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:48:49.181 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:48:49.181 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37987 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.37987/$cluster-$name.asok' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.37987/$cluster-$name.asok' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:48:49.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:48:49.183 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:48:49.183 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/2 2026-02-17T00:48:49.183 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:48:49.183 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=82fb8c57-f919-4171-b1b6-10e212bd3efe 2026-02-17T00:48:49.183 INFO:tasks.workunit.client.0.trial092.stdout:add osd2 82fb8c57-f919-4171-b1b6-10e212bd3efe 2026-02-17T00:48:49.184 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 82fb8c57-f919-4171-b1b6-10e212bd3efe' 2026-02-17T00:48:49.184 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:48:49.188 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDxupNpGCNlCxAAdesrKCjjqR0oNDsSQNJTdw== 2026-02-17T00:48:49.189 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDxupNpGCNlCxAAdesrKCjjqR0oNDsSQNJTdw=="}' 2026-02-17T00:48:49.189 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 82fb8c57-f919-4171-b1b6-10e212bd3efe -i td/bad-inc-map/2/new.json 2026-02-17T00:48:49.416 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T00:48:49.423 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/2/new.json 2026-02-17T00:48:49.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=1998f9cb-d23f-4f28-8462-a971d3f0a608 --auth-supported=none --mon-host=127.0.0.1:58709 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37987/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDxupNpGCNlCxAAdesrKCjjqR0oNDsSQNJTdw== --osd-uuid 82fb8c57-f919-4171-b1b6-10e212bd3efe 2026-02-17T00:48:49.438 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:49.440+0000 7f87ee034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:49.439 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:49.441+0000 7f87ee034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:49.440 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:49.442+0000 7f87ee034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:49.440 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:49.442+0000 7f87ee034780 -1 bdev(0x4122c00 td/bad-inc-map/2/block) open stat got: (1) Operation not permitted 2026-02-17T00:48:49.440 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:49.442+0000 7f87ee034780 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2026-02-17T00:48:49.767 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/2/keyring 2026-02-17T00:48:49.767 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:48:49.768 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T00:48:49.768 INFO:tasks.workunit.client.0.trial092.stdout:adding osd2 key to auth repository 2026-02-17T00:48:49.768 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:48:50.095 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T00:48:50.095 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:48:50.096 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=1998f9cb-d23f-4f28-8462-a971d3f0a608 --auth-supported=none --mon-host=127.0.0.1:58709 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.37987/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:48:50.096 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:48:50.096 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:48:50.096 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:48:50.109 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:50.111+0000 7f4e18034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:50.110 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:50.112+0000 7f4e18034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:50.111 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:50.113+0000 7f4e18034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:48:50.288 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:50.289+0000 7f4e18034780 -1 Falling back to public interface 2026-02-17T00:48:50.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T00:48:50.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:48:50.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:48:50.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:48:50.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:48:50.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:48:50.323 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:48:50.324 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:48:50.324 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:48:50.325 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:48:50.543 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:48:50.643 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:48:50.645+0000 7f4e18034780 -1 osd.2 0 log_to_monitors true 2026-02-17T00:48:51.544 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:48:51.544 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:48:51.544 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:48:51.545 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:48:51.545 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:48:51.545 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:48:51.764 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3446945749,v1:127.0.0.1:6819/3446945749] [v2:127.0.0.1:6820/3446945749,v1:127.0.0.1:6821/3446945749] exists,up 82fb8c57-f919-4171-b1b6-10e212bd3efe 2026-02-17T00:48:51.765 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:48:51.765 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:48:51.765 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:48:51.765 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2026-02-17T00:48:51.990 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2026-02-17T00:48:51.991 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 8 2026-02-17T00:48:52.263 INFO:tasks.workunit.client.0.trial092.stderr:pool 'foo' already exists 2026-02-17T00:48:52.271 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T00:48:53.272 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2026-02-17T00:48:53.583 INFO:tasks.workunit.client.0.trial092.stderr:set pool 1 min_size to 1 2026-02-17T00:48:53.596 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2026-02-17T00:48:53.887 INFO:tasks.workunit.client.0.trial092.stderr:set pool 1 min_size to 2 2026-02-17T00:48:53.898 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2026-02-17T00:48:58.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T00:48:58.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2026-02-17T00:48:58.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:48:58.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:48:58.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:48:58.901 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:48:58.901 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:48:58.901 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-17T00:48:58.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:48:58.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:48:58.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:48:59.122 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 21 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2758485944,v1:127.0.0.1:6801/2758485944] [v2:127.0.0.1:6802/2758485944,v1:127.0.0.1:6803/2758485944] exists,up c4e27edd-f5a6-4012-9578-03d45e110eb7 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:48:59.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:48:59.347 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 9 up_thru 21 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/542743122,v1:127.0.0.1:6811/542743122] [v2:127.0.0.1:6812/542743122,v1:127.0.0.1:6813/542743122] exists,up 57f6ed59-c7b0-43fb-a21e-fe3398a2a288 2026-02-17T00:48:59.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:48:59.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:48:59.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:48:59.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T00:48:59.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2026-02-17T00:48:59.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:48:59.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:48:59.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:48:59.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:48:59.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-17T00:48:59.349 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:48:59.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:48:59.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:48:59.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:48:59.569 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 14 up_thru 21 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3446945749,v1:127.0.0.1:6819/3446945749] [v2:127.0.0.1:6820/3446945749,v1:127.0.0.1:6821/3446945749] exists,up 82fb8c57-f919-4171-b1b6-10e212bd3efe 2026-02-17T00:48:59.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:48:59.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:48:59.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:48:59.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2026-02-17T00:48:59.571 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:52.208+0000 7f4e04b9e640 -1 osd.2 15 handle_osd_map injecting map crc failure 2026-02-17T00:48:59.571 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:52.306+0000 7f4e06ba2640 -1 osd.2 16 handle_osd_map injecting map crc failure 2026-02-17T00:48:59.571 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:52.307+0000 7f4e06ba2640 -1 osd.2 16 handle_osd_map injecting map crc failure 2026-02-17T00:48:59.571 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:52.664+0000 7f4e04b9e640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-17T00:48:59.571 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:53.481+0000 7f4e06ba2640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-17T00:48:59.571 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:53.586+0000 7f4e06ba2640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-17T00:48:59.571 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:53.788+0000 7f4e04b9e640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-17T00:48:59.571 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:53.889+0000 7f4e04b9e640 -1 osd.2 21 handle_osd_map injecting map crc failure 2026-02-17T00:48:59.571 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:53.890+0000 7f4e06ba2640 -1 osd.2 21 handle_osd_map injecting map crc failure 2026-02-17T00:48:59.572 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2026-02-17T00:48:59.573 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:52.208+0000 7f4e04b9e640 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2026-02-17T00:48:59.573 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:52.307+0000 7f4e06ba2640 10 osd.2 16 handle_osd_map bailing because last < start (16<17) 2026-02-17T00:48:59.573 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:52.308+0000 7f4e06ba2640 10 osd.2 16 handle_osd_map bailing because last < start (16<17) 2026-02-17T00:48:59.573 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:52.664+0000 7f4e04b9e640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-17T00:48:59.573 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:53.481+0000 7f4e06ba2640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-17T00:48:59.573 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:53.586+0000 7f4e06ba2640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-17T00:48:59.573 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:53.788+0000 7f4e04b9e640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-17T00:48:59.573 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:53.890+0000 7f4e04b9e640 10 osd.2 21 handle_osd_map bailing because last < start (21<22) 2026-02-17T00:48:59.573 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:48:53.890+0000 7f4e06ba2640 10 osd.2 21 handle_osd_map bailing because last < start (21<22) 2026-02-17T00:48:59.573 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2026-02-17T00:48:59.574 INFO:tasks.workunit.client.0.trial092.stdout:success 2026-02-17T00:48:59.574 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2026-02-17T00:48:59.574 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=foo 2026-02-17T00:48:59.574 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2026-02-17T00:48:59.870 INFO:tasks.workunit.client.0.trial092.stderr:pool 'foo' does not exist 2026-02-17T00:48:59.877 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2026-02-17T00:48:59.877 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:48:59.878 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:48:59.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:48:59.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:48:59.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:49:05.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:49:05.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2026-02-17T00:49:05.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-17T00:49:05.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:49:05.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T00:49:05.192 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:49:05.192 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:49:05.193 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:49:05.193 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:49:05.193 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:49:05.197 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:49:05.198 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:49:05.198 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:49:05.199 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:49:05.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:49:05.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:49:05.199 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:49:05.200 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:49:05.200 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:49:05.201 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:49:05.201 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:49:05.201 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:49:05.202 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:49:05.202 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-17T00:49:05.209 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:49:05.210 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:05.210 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37987 2026-02-17T00:49:05.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.37987 2026-02-17T00:49:05.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:49:05.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:49:05.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T00:49:05.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/bad-inc-map 0 2026-02-17T00:49:05.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-17T00:49:05.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T00:49:05.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T00:49:05.212 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:49:05.212 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:49:05.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:49:05.213 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:49:05.213 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:49:05.213 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:49:05.213 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:49:05.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:49:05.214 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:49:05.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:49:05.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:49:05.215 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:49:05.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:49:05.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:49:05.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:49:05.216 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:49:05.217 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:49:05.218 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T00:49:05.218 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-17T00:49:05.219 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:49:05.219 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:05.219 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.37987 2026-02-17T00:49:05.219 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.37987 2026-02-17T00:49:05.220 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:49:05.221 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:49:05.221 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T00:49:05.221 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T00:49:05.221 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T00:49:05.287 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2026-02-17T00:49:05.287 DEBUG:teuthology.orchestra.run.trial092:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03ef619e79a56cd363b087a5c6f19a1a09b49040 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2026-02-17T00:49:05.351 INFO:tasks.workunit.client.0.trial092.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T00:49:05.354 INFO:tasks.workunit.client.0.trial092.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T00:49:05.354 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T00:49:05.354 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T00:49:05.354 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/divergent-priors 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2026-02-17T00:49:05.355 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2026-02-17T00:49:05.356 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2026-02-17T00:49:05.356 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2026-02-17T00:49:05.357 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2026-02-17T00:49:05.357 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2026-02-17T00:49:05.357 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2026-02-17T00:49:05.358 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2026-02-17T00:49:05.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2026-02-17T00:49:05.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2026-02-17T00:49:05.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2026-02-17T00:49:05.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2026-02-17T00:49:05.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2026-02-17T00:49:05.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2026-02-17T00:49:05.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2026-02-17T00:49:05.360 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2026-02-17T00:49:05.360 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2026-02-17T00:49:05.360 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2026-02-17T00:49:05.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none ' 2026-02-17T00:49:05.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2026-02-17T00:49:05.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2026-02-17T00:49:05.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2026-02-17T00:49:05.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:49:05.361 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2026-02-17T00:49:05.361 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T00:49:05.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2026-02-17T00:49:05.363 INFO:tasks.workunit.client.0.trial092.stderr:TEST_divergent_2 2026-02-17T00:49:05.363 INFO:tasks.workunit.client.0.trial092.stderr:TEST_divergent_3 2026-02-17T00:49:05.363 INFO:tasks.workunit.client.0.trial092.stderr:TEST_divergent_ec' 2026-02-17T00:49:05.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T00:49:05.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T00:49:05.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T00:49:05.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T00:49:05.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T00:49:05.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:49:05.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T00:49:05.364 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:49:05.364 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:49:05.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:49:05.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:49:05.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:49:05.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:49:05.365 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:49:05.365 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:49:05.365 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:49:05.366 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:49:05.366 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:49:05.366 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:49:05.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:49:05.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:49:05.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:49:05.368 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:49:05.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:49:05.369 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:49:05.369 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T00:49:05.370 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:49:05.371 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:05.371 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:05.371 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44472 2026-02-17T00:49:05.371 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:49:05.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:49:05.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T00:49:05.372 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T00:49:05.373 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:05.373 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:05.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.44472 2026-02-17T00:49:05.373 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T00:49:05.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T00:49:05.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T00:49:05.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T00:49:05.375 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T00:49:05.375 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2026-02-17T00:49:05.375 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2026-02-17T00:49:05.375 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: file_with_random_data 2026-02-17T00:49:05.375 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T00:49:05.375 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T00:49:05.376 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.87SKpC5ILt 2026-02-17T00:49:05.376 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.87SKpC5ILt bs=512 count=1 2026-02-17T00:49:05.376 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records in 2026-02-17T00:49:05.376 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records out 2026-02-17T00:49:05.376 INFO:tasks.workunit.client.0.trial092.stderr:512 bytes copied, 6.1033e-05 s, 8.4 MB/s 2026-02-17T00:49:05.376 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:05.377 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: local dummyfile=/tmp/tmp.87SKpC5ILt 2026-02-17T00:49:05.377 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local num_osds=3 2026-02-17T00:49:05.377 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: expr 3 - 1 2026-02-17T00:49:05.377 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: seq 0 2 2026-02-17T00:49:05.378 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local 'osds=0 2026-02-17T00:49:05.378 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:49:05.379 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:49:05.379 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:62: TEST_divergent: run_mon td/divergent-priors a 2026-02-17T00:49:05.379 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T00:49:05.379 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T00:49:05.379 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T00:49:05.379 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T00:49:05.379 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T00:49:05.379 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T00:49:05.401 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T00:49:05.401 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:49:05.401 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:49:05.401 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:49:05.401 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:05.401 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:05.401 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:05.402 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T00:49:05.426 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T00:49:05.428 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T00:49:05.428 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:49:05.428 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:49:05.428 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T00:49:05.428 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T00:49:05.428 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:49:05.428 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:49:05.428 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:49:05.429 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:49:05.429 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:05.429 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:05.429 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-mon.a.asok 2026-02-17T00:49:05.429 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:49:05.429 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.44472/ceph-mon.a.asok config get fsid 2026-02-17T00:49:05.471 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T00:49:05.471 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:49:05.471 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:49:05.471 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T00:49:05.471 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T00:49:05.471 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:49:05.471 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:49:05.471 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:49:05.472 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:49:05.472 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:05.472 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:05.472 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-mon.a.asok 2026-02-17T00:49:05.472 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:49:05.472 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.44472/ceph-mon.a.asok config get mon_host 2026-02-17T00:49:05.513 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: run_mgr td/divergent-priors x 2026-02-17T00:49:05.513 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T00:49:05.513 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T00:49:05.513 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T00:49:05.513 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T00:49:05.513 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T00:49:05.513 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T00:49:05.616 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T00:49:05.616 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:49:05.616 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:49:05.616 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:49:05.616 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:05.616 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:05.616 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:05.617 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:49:05.617 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 0 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:05.636 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T00:49:05.637 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:49:05.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0555cb32-41a7-46c5-a0fa-0cbf6ee454ac 2026-02-17T00:49:05.638 INFO:tasks.workunit.client.0.trial092.stdout:add osd0 0555cb32-41a7-46c5-a0fa-0cbf6ee454ac 2026-02-17T00:49:05.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 0555cb32-41a7-46c5-a0fa-0cbf6ee454ac' 2026-02-17T00:49:05.638 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:49:05.652 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQABu5NpWHj9JhAARcTl/j/jyCJnqm9KQ5YFhQ== 2026-02-17T00:49:05.652 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQABu5NpWHj9JhAARcTl/j/jyCJnqm9KQ5YFhQ=="}' 2026-02-17T00:49:05.652 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0555cb32-41a7-46c5-a0fa-0cbf6ee454ac -i td/divergent-priors/0/new.json 2026-02-17T00:49:05.758 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:49:05.764 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T00:49:05.765 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQABu5NpWHj9JhAARcTl/j/jyCJnqm9KQ5YFhQ== --osd-uuid 0555cb32-41a7-46c5-a0fa-0cbf6ee454ac 2026-02-17T00:49:05.785 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:05.788+0000 7fea64632780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:05.786 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:05.789+0000 7fea64632780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:05.787 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:05.790+0000 7fea64632780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:05.787 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:05.790+0000 7fea64632780 -1 bdev(0x40fcc00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T00:49:05.787 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:05.791+0000 7fea64632780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T00:49:06.191 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T00:49:06.191 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:49:06.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T00:49:06.192 INFO:tasks.workunit.client.0.trial092.stdout:adding osd0 key to auth repository 2026-02-17T00:49:06.193 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:49:06.297 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T00:49:06.298 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:49:06.299 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:49:06.299 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:49:06.299 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:49:06.299 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:49:06.317 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:06.320+0000 7f4ba0ffd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:06.318 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:06.321+0000 7f4ba0ffd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:06.319 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:06.322+0000 7f4ba0ffd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:06.398 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T00:49:06.398 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:49:06.399 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:49:06.399 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:49:06.399 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:49:06.399 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:49:06.399 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:49:06.399 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:49:06.399 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:49:06.399 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:49:06.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:49:06.516 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:06.518+0000 7f4ba0ffd780 -1 Falling back to public interface 2026-02-17T00:49:06.817 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:06.820+0000 7f4ba0ffd780 -1 osd.0 0 log_to_monitors true 2026-02-17T00:49:07.499 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:49:07.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:49:07.500 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:49:07.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:49:07.501 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:49:07.501 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:49:07.599 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3053504562,v1:127.0.0.1:6801/3053504562] [v2:127.0.0.1:6802/3053504562,v1:127.0.0.1:6803/3053504562] exists,up 0555cb32-41a7-46c5-a0fa-0cbf6ee454ac 2026-02-17T00:49:07.599 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:49:07.599 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:49:07.599 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 1 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:07.600 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:49:07.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:49:07.602 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:49:07.602 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ec999502-f9c7-45d1-85d4-65e6aa14bb20 2026-02-17T00:49:07.602 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ec999502-f9c7-45d1-85d4-65e6aa14bb20' 2026-02-17T00:49:07.602 INFO:tasks.workunit.client.0.trial092.stdout:add osd1 ec999502-f9c7-45d1-85d4-65e6aa14bb20 2026-02-17T00:49:07.602 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:49:07.614 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQADu5NpQLDAJBAAT0uQjZvXxrXdbUTMvbA4Fw== 2026-02-17T00:49:07.614 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQADu5NpQLDAJBAAT0uQjZvXxrXdbUTMvbA4Fw=="}' 2026-02-17T00:49:07.614 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ec999502-f9c7-45d1-85d4-65e6aa14bb20 -i td/divergent-priors/1/new.json 2026-02-17T00:49:07.718 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:49:07.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T00:49:07.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQADu5NpQLDAJBAAT0uQjZvXxrXdbUTMvbA4Fw== --osd-uuid ec999502-f9c7-45d1-85d4-65e6aa14bb20 2026-02-17T00:49:07.745 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:07.748+0000 7f7ac782d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:07.746 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:07.749+0000 7f7ac782d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:07.747 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:07.750+0000 7f7ac782d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:07.748 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:07.750+0000 7f7ac782d780 -1 bdev(0x2462c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T00:49:07.748 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:07.750+0000 7f7ac782d780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T00:49:08.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T00:49:08.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:49:08.091 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T00:49:08.091 INFO:tasks.workunit.client.0.trial092.stdout:adding osd1 key to auth repository 2026-02-17T00:49:08.091 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:49:08.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T00:49:08.412 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:49:08.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:49:08.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:49:08.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:49:08.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:49:08.429 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:08.432+0000 7fa404212780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:08.430 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:08.433+0000 7fa404212780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:08.431 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:08.434+0000 7fa404212780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:08.555 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:08.557+0000 7fa404212780 -1 Falling back to public interface 2026-02-17T00:49:08.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T00:49:08.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:49:08.642 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:49:08.642 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:49:08.642 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:49:08.642 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:49:08.642 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:49:08.643 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:49:08.643 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:49:08.643 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:49:08.856 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:08.858+0000 7fa404212780 -1 osd.1 0 log_to_monitors true 2026-02-17T00:49:08.870 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:49:09.871 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:49:09.871 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:49:09.872 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:49:09.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:49:09.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:49:09.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:49:10.101 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2876452783,v1:127.0.0.1:6811/2876452783] [v2:127.0.0.1:6812/2876452783,v1:127.0.0.1:6813/2876452783] exists,up ec999502-f9c7-45d1-85d4-65e6aa14bb20 2026-02-17T00:49:10.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:49:10.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:49:10.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 2 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:49:10.104 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:49:10.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T00:49:10.106 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:49:10.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cfa332da-a817-41ed-9a4a-79436f536d83 2026-02-17T00:49:10.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 cfa332da-a817-41ed-9a4a-79436f536d83' 2026-02-17T00:49:10.106 INFO:tasks.workunit.client.0.trial092.stdout:add osd2 cfa332da-a817-41ed-9a4a-79436f536d83 2026-02-17T00:49:10.106 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:49:10.118 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAGu5NpRgw1BxAAItRzDgzpzpQGvANJo9uI2Q== 2026-02-17T00:49:10.118 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAGu5NpRgw1BxAAItRzDgzpzpQGvANJo9uI2Q=="}' 2026-02-17T00:49:10.118 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cfa332da-a817-41ed-9a4a-79436f536d83 -i td/divergent-priors/2/new.json 2026-02-17T00:49:10.351 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T00:49:10.358 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T00:49:10.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAGu5NpRgw1BxAAItRzDgzpzpQGvANJo9uI2Q== --osd-uuid cfa332da-a817-41ed-9a4a-79436f536d83 2026-02-17T00:49:10.378 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:10.381+0000 7f7bb4a2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:10.379 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:10.382+0000 7f7bb4a2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:10.380 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:10.383+0000 7f7bb4a2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:10.381 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:10.383+0000 7f7bb4a2c780 -1 bdev(0x2fc2c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T00:49:10.381 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:10.384+0000 7f7bb4a2c780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T00:49:10.712 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T00:49:10.713 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:49:10.713 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T00:49:10.713 INFO:tasks.workunit.client.0.trial092.stdout:adding osd2 key to auth repository 2026-02-17T00:49:10.713 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:49:11.032 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T00:49:11.032 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:49:11.033 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:49:11.033 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:49:11.033 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:49:11.033 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:49:11.052 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:11.055+0000 7fa011e17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:11.053 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:11.056+0000 7fa011e17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:11.054 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:11.057+0000 7fa011e17780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:11.188 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:11.190+0000 7fa011e17780 -1 Falling back to public interface 2026-02-17T00:49:11.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T00:49:11.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:49:11.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:49:11.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:49:11.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:49:11.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:49:11.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:49:11.270 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:49:11.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:49:11.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:49:11.492 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:11.495+0000 7fa011e17780 -1 osd.2 0 log_to_monitors true 2026-02-17T00:49:11.501 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:49:12.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:49:12.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:49:12.502 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:49:12.503 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:49:12.503 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:49:12.503 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:49:12.743 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2089704530,v1:127.0.0.1:6819/2089704530] [v2:127.0.0.1:6820/2089704530,v1:127.0.0.1:6821/2089704530] exists,up cfa332da-a817-41ed-9a4a-79436f536d83 2026-02-17T00:49:12.744 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:49:12.744 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:49:12.744 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:49:12.745 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: ceph osd set noout 2026-02-17T00:49:13.064 INFO:tasks.workunit.client.0.trial092.stderr:noout is set 2026-02-17T00:49:13.074 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:70: TEST_divergent: ceph osd set noin 2026-02-17T00:49:13.370 INFO:tasks.workunit.client.0.trial092.stderr:noin is set 2026-02-17T00:49:13.378 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:71: TEST_divergent: ceph osd set nodown 2026-02-17T00:49:13.673 INFO:tasks.workunit.client.0.trial092.stderr:nodown is set 2026-02-17T00:49:13.681 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: create_pool test 1 1 2026-02-17T00:49:13.681 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T00:49:13.937 INFO:tasks.workunit.client.0.trial092.stderr:pool 'test' already exists 2026-02-17T00:49:13.944 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T00:49:14.946 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd pool set test size 3 2026-02-17T00:49:15.263 INFO:tasks.workunit.client.0.trial092.stderr:set pool 1 size to 3 2026-02-17T00:49:15.272 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd pool set test min_size 2 2026-02-17T00:49:15.569 INFO:tasks.workunit.client.0.trial092.stderr:set pool 1 min_size to 2 2026-02-17T00:49:15.579 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: flush_pg_stats 2026-02-17T00:49:15.580 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:49:15.580 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:49:15.810 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:49:15.810 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:49:15.810 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:49:15.810 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:49:15.811 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:15.811 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:49:15.880 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-17T00:49:15.880 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-17T00:49:15.880 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-17T00:49:15.880 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:15.880 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:49:15.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-17T00:49:15.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-17T00:49:15.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-42949672964' 2026-02-17T00:49:15.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:15.950 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:49:16.017 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T00:49:16.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T00:49:16.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-42949672964 2-60129542147' 2026-02-17T00:49:16.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:49:16.018 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-17T00:49:16.018 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:49:16.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:49:16.019 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-17T00:49:16.019 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:49:16.020 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-17T00:49:16.020 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-17T00:49:16.021 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836484 2026-02-17T00:49:16.021 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:49:16.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T00:49:16.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:49:17.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:49:17.258 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:49:17.485 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T00:49:17.485 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:49:18.486 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T00:49:18.486 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:49:18.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-17T00:49:18.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:49:18.720 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-17T00:49:18.720 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:49:18.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:49:18.721 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-17T00:49:18.721 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:49:18.722 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-17T00:49:18.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-17T00:49:18.723 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 42949672964 2026-02-17T00:49:18.723 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:49:18.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-17T00:49:18.952 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:49:18.952 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T00:49:18.952 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:49:18.953 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:49:18.953 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T00:49:18.954 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:49:18.955 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T00:49:18.955 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T00:49:18.955 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 60129542147 2026-02-17T00:49:18.955 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:49:19.185 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542147 2026-02-17T00:49:19.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: wait_for_clean 2026-02-17T00:49:19.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:49:19.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:49:19.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:49:19.186 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T00:49:19.187 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:49:19.187 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:49:19.187 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:49:19.187 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:49:19.187 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:49:19.268 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T00:49:19.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:49:19.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:49:19.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:49:19.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:49:19.269 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:49:19.496 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:49:19.496 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:49:19.496 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:49:19.496 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:49:19.496 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:19.496 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:49:19.565 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T00:49:19.565 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T00:49:19.565 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T00:49:19.565 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:19.565 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:49:19.633 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-17T00:49:19.634 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-17T00:49:19.634 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966' 2026-02-17T00:49:19.634 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:19.634 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:49:19.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T00:49:19.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T00:49:19.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966 2-60129542150' 2026-02-17T00:49:19.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:49:19.700 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T00:49:19.700 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:49:19.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:49:19.702 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T00:49:19.702 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:49:19.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T00:49:19.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T00:49:19.703 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836487 2026-02-17T00:49:19.703 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:49:19.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T00:49:19.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:49:19.931 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-17T00:49:19.931 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:49:19.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:49:19.932 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-17T00:49:19.932 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:49:19.933 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-17T00:49:19.933 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-17T00:49:19.933 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 42949672966 2026-02-17T00:49:19.934 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:49:20.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672966 -lt 42949672966 2026-02-17T00:49:20.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:49:20.167 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T00:49:20.167 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:49:20.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:49:20.168 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T00:49:20.169 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:49:20.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T00:49:20.170 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T00:49:20.170 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 60129542150 2026-02-17T00:49:20.170 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:49:20.403 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542150 2026-02-17T00:49:20.403 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:49:21.404 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:49:21.404 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:49:21.632 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542150 2026-02-17T00:49:21.633 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:49:22.634 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T00:49:22.635 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:49:22.870 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T00:49:22.870 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:49:22.871 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:49:22.871 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:49:23.187 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:49:23.187 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:49:23.187 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:49:23.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:49:23.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:49:23.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:49:23.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:49:23.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:49:23.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T00:49:23.412 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:49:23.412 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:49:23.412 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:49:23.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T00:49:23.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T00:49:23.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T00:49:23.728 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: ceph pg dump pgs --format=json 2026-02-17T00:49:23.728 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: jq '.pg_stats[0].up_primary' 2026-02-17T00:49:23.944 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:49:23.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: local divergent=1 2026-02-17T00:49:23.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:81: TEST_divergent: echo 'primary and soon to be divergent is 1' 2026-02-17T00:49:23.951 INFO:tasks.workunit.client.0.trial092.stdout:primary and soon to be divergent is 1 2026-02-17T00:49:23.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:82: TEST_divergent: ceph pg dump pgs 2026-02-17T00:49:24.167 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:49:24.167 INFO:tasks.workunit.client.0.trial092.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T00:49:14.476613+0000 0'0 27:24 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:35:15.598922+0000 0 0 2026-02-17T00:49:24.167 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:49:24.167 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:49:24.167 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local non_divergent= 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 0 = 1 ']' 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0' 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 1 = 1 ']' 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: continue 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 2 = 1 ']' 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0 2' 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: echo 'writing initial objects' 2026-02-17T00:49:24.175 INFO:tasks.workunit.client.0.trial092.stdout:writing initial objects 2026-02-17T00:49:24.176 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: seq 1 100 2026-02-17T00:49:24.176 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.176 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_1 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.195 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.195 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_2 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_3 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.232 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.232 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_4 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.250 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.250 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_5 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_6 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.287 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.288 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_7 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.305 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.305 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_8 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_9 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.340 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.340 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_10 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_11 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.377 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.378 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_12 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_13 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_14 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_15 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_16 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.469 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.469 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_17 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.486 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.486 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_18 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.506 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.506 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_19 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.523 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.524 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_20 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.542 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.542 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_21 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_22 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.578 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.578 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_23 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.597 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.597 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_24 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.615 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.615 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_25 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.632 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.633 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_26 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.650 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.651 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_27 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.669 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.669 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_28 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_29 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.705 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.705 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_30 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_31 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_32 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_33 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.776 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.777 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_34 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.794 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.794 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_35 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.812 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.812 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_36 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.831 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.831 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_37 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.849 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.849 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_38 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.867 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.867 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_39 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.885 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.885 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_40 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_41 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_42 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.941 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.941 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_43 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.960 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.960 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_44 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.978 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.978 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_45 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:24.997 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:24.997 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_46 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_47 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.033 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.034 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_48 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.053 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.053 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_49 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.072 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.072 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_50 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_51 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_52 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.128 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.128 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_53 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.147 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.147 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_54 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_55 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.184 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.185 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_56 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.203 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.203 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_57 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.221 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.221 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_58 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_59 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_60 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.277 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.277 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_61 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.296 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.296 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_62 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.314 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.314 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_63 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.332 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.332 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_64 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.351 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.351 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_65 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.370 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.370 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_66 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_67 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.408 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.408 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_68 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.426 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.426 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_69 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.445 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.445 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_70 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_71 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.481 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.481 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_72 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_73 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.518 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.519 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_74 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.538 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.538 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_75 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.556 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.556 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_76 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.574 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.574 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_77 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.593 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.593 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_78 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_79 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.631 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.631 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_80 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.650 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.650 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_81 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.669 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.669 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_82 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.687 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.687 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_83 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.706 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.706 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_84 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_85 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.743 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.744 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_86 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.761 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.762 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_87 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.779 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.780 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_88 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.799 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.799 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_89 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.817 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.817 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_90 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.836 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.836 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_91 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_92 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.874 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.874 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_93 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.892 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.892 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_94 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.911 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.911 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_95 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_96 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.947 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.948 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_97 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_98 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:25.984 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:25.984 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_99 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:26.003 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T00:49:26.003 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_100 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:26.022 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T00:49:26.022 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: wait_for_clean 2026-02-17T00:49:26.022 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:49:26.022 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:49:26.022 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:49:26.022 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T00:49:26.023 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:49:26.023 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:49:26.023 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:49:26.023 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:49:26.023 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:49:26.074 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T00:49:26.074 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:49:26.074 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:49:26.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:49:26.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:49:26.075 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:49:26.306 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:49:26.307 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:49:26.307 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:49:26.307 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:49:26.307 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:26.307 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:49:26.376 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-17T00:49:26.376 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-17T00:49:26.376 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T00:49:26.376 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:26.377 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:49:26.444 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672970 2026-02-17T00:49:26.444 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672970 2026-02-17T00:49:26.444 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970' 2026-02-17T00:49:26.444 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:26.444 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:49:26.511 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T00:49:26.511 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T00:49:26.511 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672970 2-60129542153' 2026-02-17T00:49:26.511 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:49:26.512 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-17T00:49:26.512 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:49:26.512 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:49:26.513 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-17T00:49:26.513 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:49:26.514 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-17T00:49:26.514 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T00:49:26.514 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836490 2026-02-17T00:49:26.514 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:49:26.747 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-17T00:49:26.747 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:49:27.748 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:49:27.749 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:49:27.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-17T00:49:27.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:49:27.978 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672970 2026-02-17T00:49:27.978 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:49:27.978 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:49:27.979 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672970 2026-02-17T00:49:27.979 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:49:27.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672970 2026-02-17T00:49:27.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672970' 2026-02-17T00:49:27.981 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 42949672970 2026-02-17T00:49:27.981 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:49:28.207 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672970 -lt 42949672970 2026-02-17T00:49:28.208 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:49:28.208 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T00:49:28.208 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:49:28.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:49:28.210 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T00:49:28.210 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:49:28.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T00:49:28.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T00:49:28.211 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 60129542153 2026-02-17T00:49:28.211 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:49:28.440 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542154 -lt 60129542153 2026-02-17T00:49:28.440 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:49:28.441 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:49:28.441 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:49:28.766 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:49:28.766 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:49:28.766 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:49:28.766 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:49:28.766 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:49:28.766 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:49:28.766 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:49:28.766 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:49:28.994 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T00:49:28.995 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:49:28.995 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:49:28.995 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:49:29.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T00:49:29.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T00:49:29.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T00:49:29.317 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: get_pg test existing_1 2026-02-17T00:49:29.317 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T00:49:29.317 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T00:49:29.317 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T00:49:29.317 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T00:49:29.547 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: local pgid=1.0 2026-02-17T00:49:29.548 INFO:tasks.workunit.client.0.trial092.stdout:blackholing osds 0 2 2026-02-17T00:49:29.548 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: echo 'blackholing osds 0 2' 2026-02-17T00:49:29.548 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:105: TEST_divergent: ceph pg dump pgs 2026-02-17T00:49:29.765 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:49:29.766 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T00:49:14.476613+0000 27'100 27:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:35:15.598922+0000 0 0 2026-02-17T00:49:29.766 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:49:29.766 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:49:29.766 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:49:29.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-17T00:49:29.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.0 2026-02-17T00:49:29.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T00:49:29.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T00:49:29.775 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:49:29.775 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:29.775 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:29.775 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.0.asok 2026-02-17T00:49:29.775 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-17T00:49:29.775 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T00:49:29.817 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:49:29.817 INFO:tasks.workunit.client.0.trial092.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T00:49:29.817 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:49:29.821 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-17T00:49:29.822 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.2 2026-02-17T00:49:29.822 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T00:49:29.822 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T00:49:29.822 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:49:29.823 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:29.823 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:29.823 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.2.asok 2026-02-17T00:49:29.823 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-17T00:49:29.823 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T00:49:29.865 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:49:29.865 INFO:tasks.workunit.client.0.trial092.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T00:49:29.866 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:49:29.870 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: local case5=100 2026-02-17T00:49:29.871 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: expr 100 - 1 2026-02-17T00:49:29.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: local case3=99 2026-02-17T00:49:29.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: echo 'writing divergent object' 2026-02-17T00:49:29.872 INFO:tasks.workunit.client.0.trial092.stdout:writing divergent object 2026-02-17T00:49:29.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:116: TEST_divergent: echo 'create missing divergent object' 2026-02-17T00:49:29.873 INFO:tasks.workunit.client.0.trial092.stdout:create missing divergent object 2026-02-17T00:49:29.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2026-02-17T00:49:29.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2480: inject_eio: local pooltype=rep 2026-02-17T00:49:29.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: shift 2026-02-17T00:49:29.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: local which=data 2026-02-17T00:49:29.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: shift 2026-02-17T00:49:29.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: local poolname=test 2026-02-17T00:49:29.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: rados -p test put existing_100 /tmp/tmp.87SKpC5ILt 2026-02-17T00:49:29.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: shift 2026-02-17T00:49:29.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: local objname=existing_99 2026-02-17T00:49:29.876 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: shift 2026-02-17T00:49:29.876 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: local dir=td/divergent-priors 2026-02-17T00:49:29.876 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: shift 2026-02-17T00:49:29.876 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: local shard_id=0 2026-02-17T00:49:29.876 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: shift 2026-02-17T00:49:29.876 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: get_osds test existing_99 2026-02-17T00:49:29.876 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2026-02-17T00:49:29.876 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=existing_99 2026-02-17T00:49:29.876 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test existing_99 2026-02-17T00:49:29.876 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-17T00:49:30.107 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-17T00:49:30.108 INFO:tasks.workunit.client.0.trial092.stderr:0 2026-02-17T00:49:30.108 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:49:30.108 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2026-02-17T00:49:30.108 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: initial_osds=('1' '0' '2') 2026-02-17T00:49:30.108 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2493: inject_eio: local -a initial_osds 2026-02-17T00:49:30.108 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local osd_id=1 2026-02-17T00:49:30.108 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: '[' rep '!=' ec ']' 2026-02-17T00:49:30.108 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: shard_id= 2026-02-17T00:49:30.108 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: cat td/divergent-priors/1/type 2026-02-17T00:49:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: inject_eio: type=bluestore 2026-02-17T00:49:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T00:49:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-17T00:49:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-17T00:49:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T00:49:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-17T00:49:30.111 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-17T00:49:30.111 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-17T00:49:30.111 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T00:49:30.112 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T00:49:30.112 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:49:30.112 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:30.112 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:30.112 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.1.asok 2026-02-17T00:49:30.112 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.44472/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T00:49:30.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-17T00:49:30.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: local loop=0 2026-02-17T00:49:30.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: grep -q Invalid 2026-02-17T00:49:30.159 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: get_asok_path osd.1 2026-02-17T00:49:30.159 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T00:49:30.159 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T00:49:30.159 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:49:30.160 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:30.160 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:30.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.1.asok 2026-02-17T00:49:30.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: CEPH_ARGS= 2026-02-17T00:49:30.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.1.asok injectdataerr test existing_99 2026-02-17T00:49:30.207 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: sleep 10 2026-02-17T00:49:30.207 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2026-02-17T00:49:40.207 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: killall -9 rados 2026-02-17T00:49:40.244 INFO:tasks.workunit.client.0.trial092.stderr:rados: no process found 2026-02-17T00:49:40.244 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: echo 'killing all the osds' 2026-02-17T00:49:40.245 INFO:tasks.workunit.client.0.trial092.stdout:killing all the osds 2026-02-17T00:49:40.245 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:124: TEST_divergent: ceph pg dump pgs 2026-02-17T00:49:40.463 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:49:40.464 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 active+clean 2026-02-17T00:49:30.219323+0000 27'101 27:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:35:15.598922+0000 0 0 2026-02-17T00:49:40.464 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:49:40.464 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:49:40.464 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:49:40.471 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:125: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2026-02-17T00:49:40.471 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:49:40.471 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:49:40.472 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:49:40.472 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:49:40.472 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:49:40.580 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:49:40.580 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-17T00:49:40.580 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.0 2026-02-17T00:49:40.867 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already down. 2026-02-17T00:49:40.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-17T00:49:40.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.1 2026-02-17T00:49:41.157 INFO:tasks.workunit.client.0.trial092.stderr:osd.1 is already down. 2026-02-17T00:49:41.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-17T00:49:41.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.2 2026-02-17T00:49:41.444 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already down. 2026-02-17T00:49:41.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-17T00:49:41.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.0 2026-02-17T00:49:41.732 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already out. 2026-02-17T00:49:41.739 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-17T00:49:41.739 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.2 2026-02-17T00:49:42.018 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already out. 2026-02-17T00:49:42.026 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:136: TEST_divergent: echo 'bringing up non_divergent 0 2' 2026-02-17T00:49:42.026 INFO:tasks.workunit.client.0.trial092.stdout:bringing up non_divergent 0 2 2026-02-17T00:49:42.026 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:137: TEST_divergent: ceph pg dump pgs 2026-02-17T00:49:42.254 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:49:42.254 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 stale+active+clean 2026-02-17T00:49:30.219323+0000 27'101 27:133 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:35:15.598922+0000 0 0 2026-02-17T00:49:42.254 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:49:42.254 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:49:42.254 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 0 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T00:49:42.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:49:42.263 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:49:42.263 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:49:42.263 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:49:42.263 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:49:42.263 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T00:49:42.264 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:49:42.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:49:42.265 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T00:49:42.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T00:49:42.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:49:42.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:49:42.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:49:42.282 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:42.274+0000 7fbe6c00f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:42.284 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:42.276+0000 7fbe6c00f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:42.285 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:42.277+0000 7fbe6c00f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:42.405 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:42.397+0000 7fbe6c00f780 -1 Falling back to public interface 2026-02-17T00:49:42.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T00:49:42.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:49:42.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:49:42.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:49:42.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:49:42.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:49:42.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:49:42.494 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:49:42.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:49:42.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:49:42.718 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:42.710+0000 7fbe6c00f780 -1 osd.0 27 log_to_monitors true 2026-02-17T00:49:42.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:49:43.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:49:43.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:49:43.726 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:49:43.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:49:43.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:49:43.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:49:43.961 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up out weight 0 up_from 34 up_thru 0 down_at 28 last_clean_interval [5,27) [v2:127.0.0.1:6800/3230366333,v1:127.0.0.1:6801/3230366333] [v2:127.0.0.1:6802/3230366333,v1:127.0.0.1:6803/3230366333] exists,up 0555cb32-41a7-46c5-a0fa-0cbf6ee454ac 2026-02-17T00:49:43.964 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:49:43.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:49:43.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:49:43.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-17T00:49:43.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 2 2026-02-17T00:49:43.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:49:43.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:49:43.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T00:49:43.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:49:43.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T00:49:43.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:49:43.966 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:49:43.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:49:43.968 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T00:49:43.968 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T00:49:43.968 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:49:43.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:49:43.969 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T00:49:43.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T00:49:43.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:49:43.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:49:43.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:49:43.983 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:43.975+0000 7fa18c7d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:43.984 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:43.976+0000 7fa18c7d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:43.985 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:43.977+0000 7fa18c7d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:49:44.132 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:44.123+0000 7fa18c7d8780 -1 Falling back to public interface 2026-02-17T00:49:44.196 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T00:49:44.197 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:49:44.197 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:49:44.197 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:49:44.197 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:49:44.197 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:49:44.198 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:49:44.198 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:49:44.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:49:44.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:49:44.427 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:49:44.428 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:49:44.420+0000 7fa18c7d8780 -1 osd.2 27 log_to_monitors true 2026-02-17T00:49:45.428 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:49:45.428 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:49:45.428 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:49:45.428 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:49:45.428 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:49:45.428 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:49:45.660 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [14,27) [v2:127.0.0.1:6810/2714247265,v1:127.0.0.1:6811/2714247265] [v2:127.0.0.1:6812/2714247265,v1:127.0.0.1:6813/2714247265] exists,up cfa332da-a817-41ed-9a4a-79436f536d83 2026-02-17T00:49:45.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:49:45.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:49:45.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:49:45.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-17T00:49:45.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.0 2026-02-17T00:49:45.941 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already in. 2026-02-17T00:49:45.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-17T00:49:45.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.2 2026-02-17T00:49:46.231 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already in. 2026-02-17T00:49:46.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T00:49:46.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: wait_for_clean 2026-02-17T00:49:46.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:49:46.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:49:46.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:49:46.241 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T00:49:46.241 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:49:46.241 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:49:46.242 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:49:46.242 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:49:46.242 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:49:46.292 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T00:49:46.292 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:49:46.292 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:49:46.292 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:49:46.292 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:49:46.292 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:49:46.521 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:49:46.521 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:49:46.521 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:49:46.521 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:49:46.521 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:46.522 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:49:46.591 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888067 2026-02-17T00:49:46.591 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888067 2026-02-17T00:49:46.591 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888067' 2026-02-17T00:49:46.591 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:46.591 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:49:46.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T00:49:46.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T00:49:46.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T00:49:46.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T00:49:46.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:49:46.640 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:49:46.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-17T00:49:46.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-17T00:49:46.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-146028888067 2-154618822659' 2026-02-17T00:49:46.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:49:46.707 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-146028888067 2026-02-17T00:49:46.707 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:49:46.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:49:46.709 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-146028888067 2026-02-17T00:49:46.709 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:49:46.710 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888067 2026-02-17T00:49:46.710 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 146028888067' 2026-02-17T00:49:46.710 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 146028888067 2026-02-17T00:49:46.710 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:49:46.943 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 146028888067 2026-02-17T00:49:46.944 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:49:47.944 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:49:47.945 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:49:48.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888067 -lt 146028888067 2026-02-17T00:49:48.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:49:48.174 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-154618822659 2026-02-17T00:49:48.174 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:49:48.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:49:48.175 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-154618822659 2026-02-17T00:49:48.175 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:49:48.176 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822659 2026-02-17T00:49:48.176 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 154618822659 2026-02-17T00:49:48.177 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 154618822659' 2026-02-17T00:49:48.177 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:49:48.404 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-17T00:49:48.404 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:49:48.405 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:49:48.405 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:49:48.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:49:48.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:49:48.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:49:48.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:49:48.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:49:48.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:49:48.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:49:48.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:49:48.955 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:49:48.956 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:49:48.956 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:49:48.956 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:49:49.278 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:49:49.279 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T00:49:49.279 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T00:49:49.279 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T00:49:49.279 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:49:49.279 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T00:49:49.380 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:49:49.381 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:49:49.381 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:49:49.381 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:49:49.381 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:49:49.381 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:49:49.381 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:49:49.381 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:49:49.614 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:49:49.614 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:49:49.615 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:49:49.615 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:49:49.933 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:49:49.933 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:49:49.934 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:49:49.934 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:49:49.934 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:49:49.934 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:49:49.934 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:49:49.934 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:49:49.934 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:49:50.253 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:49:50.254 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:49:50.254 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T00:49:50.254 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:49:50.254 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T00:49:50.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:49:50.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:49:50.455 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:49:50.456 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:49:50.456 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:49:50.456 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:49:50.456 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:49:50.456 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:49:50.680 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:49:50.680 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:49:50.681 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:49:50.681 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:49:51.014 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:49:51.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:49:51.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:49:51.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:49:51.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:49:51.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:49:51.016 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:49:51.016 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:49:51.016 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:49:51.337 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:49:51.337 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:49:51.337 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T00:49:51.337 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:49:51.338 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T00:49:51.738 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:49:51.739 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:49:51.739 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:49:51.739 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:49:51.739 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:49:51.739 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:49:51.740 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:49:51.740 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:49:51.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:49:51.966 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:49:51.966 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:49:51.966 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:49:52.309 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:49:52.309 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:49:52.309 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:49:52.309 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:49:52.310 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:49:52.310 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:49:52.310 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:49:52.310 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:49:52.310 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:49:52.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:49:52.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:49:52.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T00:49:52.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:49:52.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T00:49:53.438 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:49:53.438 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:49:53.438 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:49:53.438 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:49:53.439 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:49:53.439 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:49:53.439 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:49:53.439 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:49:53.664 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:49:53.664 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:49:53.665 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:49:53.665 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:49:53.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:49:53.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:49:53.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:49:53.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:49:53.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:49:53.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:49:53.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:49:53.978 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:49:53.978 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:49:54.294 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:49:54.294 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:49:54.294 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T00:49:54.294 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:49:54.294 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T00:49:55.895 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:49:55.896 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:49:55.896 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:49:55.896 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:49:55.896 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:49:55.896 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:49:55.896 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:49:55.896 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:49:56.133 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:49:56.134 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:49:56.134 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:49:56.134 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:49:56.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:49:56.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:49:56.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:49:56.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:49:56.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:49:56.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:49:56.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:49:56.456 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:49:56.456 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:49:56.780 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:49:56.780 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:49:56.780 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T00:49:56.780 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:49:56.781 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T00:49:59.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:49:59.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:49:59.980 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:49:59.980 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:49:59.980 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:49:59.980 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:49:59.981 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:49:59.981 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:50:00.206 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:50:00.206 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:50:00.207 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:50:00.207 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:50:00.525 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:50:00.525 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:50:00.525 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:50:00.525 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:50:00.525 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:50:00.526 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:50:00.526 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:50:00.526 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:50:00.526 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:50:00.842 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:50:00.842 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:50:00.842 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T00:50:00.842 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:50:00.842 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T00:50:07.243 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:50:07.243 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:50:07.243 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:50:07.244 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:50:07.244 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:50:07.244 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:50:07.244 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:50:07.244 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:50:07.471 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:50:07.472 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:50:07.472 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:50:07.472 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:50:07.793 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:50:07.794 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:50:07.794 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:50:07.794 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:50:07.794 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:50:07.794 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:50:07.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:50:07.795 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:50:07.795 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:50:08.112 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:50:08.112 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:50:08.112 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T00:50:08.112 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:50:08.113 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T00:50:15.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:50:15.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:50:15.414 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:50:15.414 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:50:15.414 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:50:15.414 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:50:15.414 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:50:15.414 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:50:15.645 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:50:15.646 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:50:15.646 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:50:15.646 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:50:15.961 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:50:15.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:50:15.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:50:15.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:50:15.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:50:15.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:50:15.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:50:15.962 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:50:15.962 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:50:16.280 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:50:16.280 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:50:16.280 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T00:50:16.280 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T00:50:16.587 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:50:16.587 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_fingerprint": "69c7fc28-50da-41a8-bae7-c417fa2fa471", 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "version": "20.3.0-5225-g03ef619e", 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "commit": "03ef619e79a56cd363b087a5c6f19a1a09b49040", 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "timestamp": "2026-02-17T00:50:16.580362+0000", 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "tag": "", 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "health": { 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "status": "HEALTH_WARN", 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "checks": { 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "OSDMAP_FLAGS": { 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "count": 17 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [], 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "OSD_DOWN": { 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "message": "1 osds down", 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "count": 1 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "message": "osd.1 (root=default,host=trial092) is down" 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "PG_DEGRADED": { 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:50:16.588 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "count": 1 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "mutes": [] 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_first_committed": 1, 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_last_committed": 1, 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "monmap": { 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:49:05.396573Z", 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:49:05.396573Z", 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release": 20, 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release_name": "tentacle", 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "election_strategy": 1, 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "disallowed_leaders": "", 2026-02-17T00:50:16.589 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": false, 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "tiebreaker_mon": "", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "removed_ranks": "", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "features": { 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "persistent": [ 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "kraken", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "luminous", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "mimic", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap-prune", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "nautilus", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "octopus", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "pacific", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "elector-pinging", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "quincy", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "reef", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "squid", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "tentacle", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "nvmeof_beacon_diff" 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "optional": [] 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "mons": [ 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "rank": 0, 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "name": "a", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115", 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 0 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.590 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "priority": 0, 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 0, 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "time_added": "2026-02-17T00:49:05:396569+0000", 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "crush_location": [] 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "quorum": [ 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: 0 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap": { 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 40, 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:49:05.431872+0000", 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:49:46.259154+0000", 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "last_up_change": "2026-02-17T00:49:44.600982+0000", 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "last_in_change": "2026-02-17T00:49:46.156361+0000", 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T00:50:16.591 INFO:tasks.workunit.client.0.trial092.stdout: "flags_num": 5800384, 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "flags_set": [ 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "nodown", 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "noin", 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "noout", 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "pglog_hardlimit", 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snapdirs", 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "recovery_deletes", 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "sortbitwise" 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "crush_version": 9, 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_snapshot": "", 2026-02-17T00:50:16.592 INFO:tasks.workunit.client.0.trial092.stdout: "pool_max": 1, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "max_osd": 3, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "require_min_compat_client": "luminous", 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "min_compat_client": "jewel", 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "require_osd_release": "tentacle", 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "allow_crimson": false, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "pools": [ 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "pool_name": "test", 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "create_time": "2026-02-17T00:49:13.848686+0000", 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "flags": 1, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "flags_names": "hashpspool", 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "size": 3, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "min_size": 2, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "crush_rule": 0, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_count": 0, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_target": 0, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "is_stretch_pool": false, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "object_hash": 2, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "pg_autoscale_mode": "off", 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num": 1, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num": 1, 2026-02-17T00:50:16.593 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num_target": 1, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_target": 1, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_pending": 1, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "last_pg_merge_meta": { 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "source_pgid": "0.0", 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "ready_epoch": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_started": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "source_version": "0'0", 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "target_version": "0'0" 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "last_change": "27", 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend": "0", 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "auid": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "snap_mode": "selfmanaged", 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "snap_seq": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "snap_epoch": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "pool_snaps": [], 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps": "[]", 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_bytes": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_objects": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "tiers": [], 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "tier_of": -1, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "read_tier": -1, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "write_tier": -1, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "cache_mode": "none", 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_bytes": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_objects": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_flush_age": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_evict_age": 0, 2026-02-17T00:50:16.594 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profile": "", 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_params": { 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "type": "none" 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_period": 0, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_count": 0, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "use_gmt_hitset": true, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "min_read_recency_for_promote": 0, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "min_write_recency_for_promote": 0, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_search_last_n": 0, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "grade_table": [], 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "stripe_width": 0, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "expected_num_objects": 0, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "fast_read": false, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "nonprimary_shards": "{}", 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "options": {}, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "application_metadata": {}, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "read_balance": { 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "score_type": "Fair distribution", 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "score_acting": 2.9900000095367432, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "score_stable": 2.9900000095367432, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "raw_score_acting": 2, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "raw_score_stable": 2, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity_weighted": 1, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "average_primary_affinity": 1, 2026-02-17T00:50:16.595 INFO:tasks.workunit.client.0.trial092.stdout: "average_primary_affinity_weighted": 1 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "osds": [ 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "0555cb32-41a7-46c5-a0fa-0cbf6ee454ac", 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 5, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 27, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 34, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 39, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 28, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6800", 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3230366333 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6801", 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3230366333 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.596 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6802", 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3230366333 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6803", 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3230366333 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6806", 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3230366333 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6807", 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3230366333 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:50:16.597 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6804", 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3230366333 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6805", 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3230366333 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6801/3230366333", 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6803/3230366333", 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3230366333", 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3230366333", 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "ec999502-f9c7-45d1-85d4-65e6aa14bb20", 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "up": 0, 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:50:16.598 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 0, 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 0, 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 10, 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 21, 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 29, 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2876452783 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2876452783 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2876452783 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2876452783 2026-02-17T00:50:16.599 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2876452783 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2876452783 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.600 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2876452783 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2876452783 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/2876452783", 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/2876452783", 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2876452783", 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2876452783", 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "exists" 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "cfa332da-a817-41ed-9a4a-79436f536d83", 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 14, 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 27, 2026-02-17T00:50:16.601 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 36, 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 0, 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 30, 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2714247265 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2714247265 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:50:16.602 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2714247265 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2714247265 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2714247265 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.603 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2714247265 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2714247265 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2714247265 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/2714247265", 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/2714247265", 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2714247265", 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2714247265", 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: "osd_xinfo": [ 2026-02-17T00:50:16.604 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:49:40.793712+0000", 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:49:07.834589+0000", 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:49:41.082672+0000", 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:49:41.371364+0000", 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:49:12.530863+0000", 2026-02-17T00:50:16.605 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap": [], 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_items": [], 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_primaries": [], 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "pg_temp": [], 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "primary_temp": [], 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "blocklist": {}, 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "range_blocklist": {}, 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profiles": { 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "default": { 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "k": "2", 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "m": "2", 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "plugin": "isa", 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "technique": "reed_sol_van" 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps_queue": [], 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "new_removed_snaps": [], 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "new_purged_snaps": [], 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "crush_node_flags": {}, 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "device_class_flags": {}, 2026-02-17T00:50:16.606 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": { 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_enabled": false, 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_bucket_count": 0, 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "degraded_stretch_mode": 0, 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "recovering_stretch_mode": 0, 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_bucket": 0 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "osd_metadata": [ 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6802/3230366333,v1:127.0.0.1:6803/3230366333]", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:50:16.607 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:49:06.138479Z", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6800/3230366333,v1:127.0.0.1:6801/3230366333]", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3230366333,v1:127.0.0.1:6807/3230366333]", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3230366333,v1:127.0.0.1:6805/3230366333]", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:50:16.608 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/2876452783,v1:127.0.0.1:6813/2876452783]", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:50:16.609 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:49:08.046665Z", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:50:16.610 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/2876452783,v1:127.0.0.1:6811/2876452783]", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2876452783,v1:127.0.0.1:6817/2876452783]", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2876452783,v1:127.0.0.1:6815/2876452783]", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:50:16.611 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/2714247265,v1:127.0.0.1:6813/2714247265]", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:50:16.612 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:50:16.613 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:49:10.668753Z", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/2714247265,v1:127.0.0.1:6811/2714247265]", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:50:16.614 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2714247265,v1:127.0.0.1:6817/2714247265]", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2714247265,v1:127.0.0.1:6815/2714247265]", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:50:16.615 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_clean_epochs": { 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: "min_last_epoch_clean": 0, 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": { 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: "per_pool": [] 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: "osd_epochs": [ 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 34 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.616 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 36 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_first_committed": 1, 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_last_committed": 40, 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "crushmap": { 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "devices": [ 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.0", 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.1", 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.617 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.2", 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: "types": [ 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 0, 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd" 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: "name": "host" 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 2, 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: "name": "chassis" 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 3, 2026-02-17T00:50:16.618 INFO:tasks.workunit.client.0.trial092.stdout: "name": "rack" 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 4, 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: "name": "row" 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 5, 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pdu" 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 6, 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pod" 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 7, 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: "name": "room" 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 8, 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: "name": "datacenter" 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.619 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 9, 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "name": "zone" 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 10, 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "name": "region" 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "name": "root" 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "buckets": [ 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "id": -1, 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default", 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.620 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "id": -2, 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default~ssd", 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.621 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092", 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.622 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092~ssd", 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:50:16.623 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "rules": [ 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "rule_id": 0, 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "rule_name": "replicated_rule", 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "steps": [ 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "op": "take", 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "item": -1, 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "item_name": "default" 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "op": "choose_firstn", 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "num": 0, 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "type": "osd" 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: "op": "emit" 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:50:16.624 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "tunables": { 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_tries": 0, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_fallback_tries": 0, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "choose_total_tries": 50, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_descend_once": 1, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_vary_r": 1, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_stable": 1, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "msr_descents": 100, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "msr_collision_tries": 100, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "straw_calc_version": 1, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "allowed_bucket_algs": 54, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "profile": "jewel", 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_tunables": 1, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "legacy_tunables": 0, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "minimum_required_version": "jewel", 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables": 1, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables2": 1, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "has_v2_rules": 0, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables3": 1, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "has_v3_rules": 0, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "has_v4_buckets": 1, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables5": 1, 2026-02-17T00:50:16.625 INFO:tasks.workunit.client.0.trial092.stderr:report 2253849327 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "has_v5_rules": 0, 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "has_msr_rules": 0 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "choose_args": {} 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "fsmap": { 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "btime": "2026-02-17T00:49:05:431713+0000", 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "default_fscid": -1, 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "compat": { 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "compat": {}, 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "ro_compat": {}, 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "incompat": { 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "feature_1": "base v0.20", 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "feature_2": "client writeable ranges", 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "feature_4": "dir inode in separate object", 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T00:50:16.626 INFO:tasks.workunit.client.0.trial092.stdout: "feature_8": "no anchor table", 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "feature_9": "file layout v2", 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "feature_10": "snaprealm v2", 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "feature_11": "minor log segments", 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "feature_flags": { 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "enable_multiple": true, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "ever_enabled_multiple": true 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "standbys": [], 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "filesystems": [] 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_first_committed": 1, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_last_committed": 1, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "auth": { 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 5, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "num_secrets": 3 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 1, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_active": 1, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_unknown": 0, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "num_osd": 3, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "pool_sum": { 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 51200, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 100, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 0, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 300, 2026-02-17T00:50:16.627 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 100, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 100, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 100, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 100, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:50:16.628 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 16, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 16, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "up": 2, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 2, 2026-02-17T00:50:16.629 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 0 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum": { 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 3, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83860, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2080, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 24, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81703, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488940, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036674560, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2129920, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 420674, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 25402, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83664070 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 1, 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:50:16.630 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum_by_class": { 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "ssd": { 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 3, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83860, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2080, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 24, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81703, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488940, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036674560, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2129920, 2026-02-17T00:50:16.631 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 420674, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 25402, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83664070 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 1, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "pool_stats": [ 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": 1, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 1, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 51200, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 100, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 0, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 300, 2026-02-17T00:50:16.632 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 100, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 100, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 100, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 100, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:50:16.633 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 1228800, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 153600, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 16, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 16, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "up": 2, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 2, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 3 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "osd_stats": [ 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 146028888073 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.634 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 42949672973 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 154618822665 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_state": [ 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "state": "active+undersized+degraded", 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "num": 1 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "pool_pg_unavailable_map": [ 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": "1", 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "pgs": [] 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_osd": [ 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 1, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:50:16.635 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 0, 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": [ 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": {} 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "servicemap": { 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 3, 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:50:11.667669+0000", 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "services": { 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "osd": { 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "daemons": { 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "summary": "", 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "0": { 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "start_epoch": 0, 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "start_stamp": "0.000000", 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "gid": 0, 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T00:50:16.636 INFO:tasks.workunit.client.0.trial092.stdout: "metadata": {}, 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "task_status": {} 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "2": { 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "start_epoch": 0, 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "start_stamp": "0.000000", 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "gid": 0, 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "metadata": {}, 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "task_status": {} 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_first_committed": 1, 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_last_committed": 36, 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "logm_first_committed": 1, 2026-02-17T00:50:16.637 INFO:tasks.workunit.client.0.trial092.stdout: "logm_last_committed": 218, 2026-02-17T00:50:16.638 INFO:tasks.workunit.client.0.trial092.stdout: "paxos": { 2026-02-17T00:50:16.638 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:50:16.638 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 304, 2026-02-17T00:50:16.638 INFO:tasks.workunit.client.0.trial092.stdout: "last_pn": 0, 2026-02-17T00:50:16.638 INFO:tasks.workunit.client.0.trial092.stdout: "accepted_pn": 0 2026-02-17T00:50:16.638 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:50:16.638 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:50:16.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T00:50:16.638 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: expr 2 + 2 2026-02-17T00:50:16.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: objname=existing_4 2026-02-17T00:50:16.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:151: TEST_divergent: echo 'writing non-divergent object existing_4' 2026-02-17T00:50:16.639 INFO:tasks.workunit.client.0.trial092.stdout:writing non-divergent object existing_4 2026-02-17T00:50:16.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:152: TEST_divergent: ceph pg dump pgs 2026-02-17T00:50:16.816 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:50:16.816 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:49:46.262654+0000 27'100 40:132 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:43:02.645995+0000 0 0 2026-02-17T00:50:16.816 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:50:16.816 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:50:16.816 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:50:16.824 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: dd if=/dev/urandom bs=1000 count=1 2026-02-17T00:50:16.824 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: rados -p test put existing_4 - 2026-02-17T00:50:16.825 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records in 2026-02-17T00:50:16.825 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records out 2026-02-17T00:50:16.825 INFO:tasks.workunit.client.0.trial092.stderr:1000 bytes (1.0 kB) copied, 2.2442e-05 s, 44.6 MB/s 2026-02-17T00:50:16.844 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:157: TEST_divergent: echo 'delay recovery' 2026-02-17T00:50:16.844 INFO:tasks.workunit.client.0.trial092.stdout:delay recovery 2026-02-17T00:50:16.845 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:158: TEST_divergent: ceph pg dump pgs 2026-02-17T00:50:17.063 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:50:17.063 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:49:46.262654+0000 27'100 40:132 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:43:02.645995+0000 0 0 2026-02-17T00:50:17.063 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:50:17.064 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:50:17.064 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:50:17.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-17T00:50:17.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.0 2026-02-17T00:50:17.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T00:50:17.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T00:50:17.072 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:50:17.072 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:17.072 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:17.072 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.0.asok 2026-02-17T00:50:17.072 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-17T00:50:17.072 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T00:50:17.118 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:50:17.121 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-17T00:50:17.122 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.2 2026-02-17T00:50:17.122 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T00:50:17.122 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T00:50:17.122 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:50:17.122 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:17.122 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:17.122 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.2.asok 2026-02-17T00:50:17.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-17T00:50:17.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T00:50:17.168 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:50:17.173 INFO:tasks.workunit.client.0.trial092.stdout:revive divergent 1 2026-02-17T00:50:17.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:165: TEST_divergent: echo 'revive divergent 1' 2026-02-17T00:50:17.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:166: TEST_divergent: ceph pg dump pgs 2026-02-17T00:50:17.390 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:50:17.390 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:49:46.262654+0000 27'100 40:132 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:43:02.645995+0000 0 0 2026-02-17T00:50:17.391 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:50:17.391 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:50:17.391 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:50:17.398 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: ceph osd set noup 2026-02-17T00:50:17.715 INFO:tasks.workunit.client.0.trial092.stderr:noup is set 2026-02-17T00:50:17.724 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-17T00:50:17.724 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:17.725 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:50:17.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:50:17.727 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T00:50:17.727 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:50:17.727 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:50:17.727 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T00:50:17.727 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T00:50:17.727 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:50:17.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:50:17.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:50:17.744 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:17.737+0000 7fb067e21780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:17.745 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:17.738+0000 7fb067e21780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:17.746 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:17.739+0000 7fb067e21780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:17.914 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:17.906+0000 7fb067e21780 -1 Falling back to public interface 2026-02-17T00:50:17.957 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T00:50:17.957 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: sleep 5 2026-02-17T00:50:18.204 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:18.196+0000 7fb067e21780 -1 osd.1 27 log_to_monitors true 2026-02-17T00:50:22.958 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: echo 'delay recovery divergent' 2026-02-17T00:50:22.959 INFO:tasks.workunit.client.0.trial092.stdout:delay recovery divergent 2026-02-17T00:50:22.959 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:172: TEST_divergent: ceph pg dump pgs 2026-02-17T00:50:23.175 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:50:23.175 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:49:46.262654+0000 40'101 42:137 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:43:02.645995+0000 0 0 2026-02-17T00:50:23.175 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:50:23.175 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:50:23.176 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:50:23.183 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: get_asok_path osd.1 2026-02-17T00:50:23.183 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T00:50:23.184 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T00:50:23.184 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:50:23.184 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:23.184 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:23.184 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.1.asok 2026-02-17T00:50:23.184 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: CEPH_ARGS= 2026-02-17T00:50:23.184 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T00:50:23.230 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:50:23.233 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph osd unset noup 2026-02-17T00:50:23.552 INFO:tasks.workunit.client.0.trial092.stderr:noup is unset 2026-02-17T00:50:23.565 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: wait_for_osd up 0 2026-02-17T00:50:23.565 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:50:23.565 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:50:23.565 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:50:23.566 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:50:23.566 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:50:23.566 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:50:23.566 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:50:23.567 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:50:23.567 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:50:23.796 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 34 up_thru 39 down_at 28 last_clean_interval [5,27) [v2:127.0.0.1:6800/3230366333,v1:127.0.0.1:6801/3230366333] [v2:127.0.0.1:6802/3230366333,v1:127.0.0.1:6803/3230366333] exists,up 0555cb32-41a7-46c5-a0fa-0cbf6ee454ac 2026-02-17T00:50:23.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:50:23.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:50:23.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:50:23.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:178: TEST_divergent: wait_for_osd up 1 2026-02-17T00:50:23.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:50:23.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:50:23.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:50:23.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:50:23.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:50:23.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:50:23.798 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:50:23.798 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:50:23.798 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:50:24.037 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 29 last_clean_interval [10,27) [v2:127.0.0.1:6818/2988637783,v1:127.0.0.1:6819/2988637783] [v2:127.0.0.1:6820/2988637783,v1:127.0.0.1:6821/2988637783] exists,up ec999502-f9c7-45d1-85d4-65e6aa14bb20 2026-02-17T00:50:24.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:50:24.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:50:24.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:50:24.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 2 2026-02-17T00:50:24.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:50:24.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:50:24.039 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:50:24.039 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:50:24.039 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:50:24.039 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:50:24.039 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:50:24.040 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:50:24.040 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:50:24.268 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 36 up_thru 0 down_at 30 last_clean_interval [14,27) [v2:127.0.0.1:6810/2714247265,v1:127.0.0.1:6811/2714247265] [v2:127.0.0.1:6812/2714247265,v1:127.0.0.1:6813/2714247265] exists,up cfa332da-a817-41ed-9a4a-79436f536d83 2026-02-17T00:50:24.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:50:24.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:50:24.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:50:24.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: ceph pg dump pgs 2026-02-17T00:50:24.489 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:50:24.489 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:49:46.262654+0000 40'101 43:139 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:43:02.645995+0000 0 0 2026-02-17T00:50:24.490 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:50:24.490 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:50:24.490 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:50:24.497 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:182: TEST_divergent: echo 'wait for peering' 2026-02-17T00:50:24.497 INFO:tasks.workunit.client.0.trial092.stdout:wait for peering 2026-02-17T00:50:24.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2026-02-17T00:50:24.715 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:50:24.715 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:49:46.262654+0000 40'101 43:139 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:43:02.645995+0000 0 0 2026-02-17T00:50:24.715 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:50:24.715 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:50:24.715 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:50:24.722 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: rados -p test put foo /tmp/tmp.87SKpC5ILt 2026-02-17T00:50:24.742 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: echo 'killing divergent 1' 2026-02-17T00:50:24.743 INFO:tasks.workunit.client.0.trial092.stdout:killing divergent 1 2026-02-17T00:50:24.743 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:187: TEST_divergent: ceph pg dump pgs 2026-02-17T00:50:24.960 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:50:24.960 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:49:46.262654+0000 40'101 43:139 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:43:02.645995+0000 0 0 2026-02-17T00:50:24.960 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:50:24.960 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:50:24.960 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:50:24.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T00:50:24.967 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:50:24.967 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:50:24.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:50:24.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:50:24.968 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:50:25.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:50:25.073 INFO:tasks.workunit.client.0.trial092.stdout:reviving divergent 1 2026-02-17T00:50:25.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: echo 'reviving divergent 1' 2026-02-17T00:50:25.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:191: TEST_divergent: ceph pg dump pgs 2026-02-17T00:50:25.291 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:50:25.291 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:49:46.262654+0000 40'101 43:139 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:43:02.645995+0000 0 0 2026-02-17T00:50:25.291 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:50:25.291 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:50:25.291 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:50:25.301 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:50:25.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:50:25.303 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:50:25.304 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:50:25.304 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:50:25.304 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:50:25.304 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:50:25.304 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:50:25.304 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T00:50:25.304 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:50:25.305 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:50:25.305 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T00:50:25.305 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T00:50:25.305 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:50:25.305 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:50:25.305 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:50:25.319 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:25.312+0000 7ff0fb019780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:25.321 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:25.314+0000 7ff0fb019780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:25.322 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:25.315+0000 7ff0fb019780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:25.452 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:25.445+0000 7ff0fb019780 -1 Falling back to public interface 2026-02-17T00:50:25.533 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T00:50:25.533 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:50:25.533 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:50:25.533 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:50:25.533 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:50:25.533 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:50:25.533 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:50:25.533 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:50:25.534 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:50:25.534 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:50:25.773 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:25.766+0000 7ff0fb019780 -1 osd.1 47 log_to_monitors true 2026-02-17T00:50:25.773 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 29 last_clean_interval [10,27) [v2:127.0.0.1:6818/2988637783,v1:127.0.0.1:6819/2988637783] [v2:127.0.0.1:6820/2988637783,v1:127.0.0.1:6821/2988637783] exists,up ec999502-f9c7-45d1-85d4-65e6aa14bb20 2026-02-17T00:50:25.774 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:50:25.774 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:50:25.774 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:50:25.774 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: sleep 20 2026-02-17T00:50:45.774 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: echo 'allowing recovery' 2026-02-17T00:50:45.774 INFO:tasks.workunit.client.0.trial092.stdout:allowing recovery 2026-02-17T00:50:45.774 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:197: TEST_divergent: ceph pg dump pgs 2026-02-17T00:50:45.992 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:50:45.992 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-17T00:50:26.565500+0000 47'102 51:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:03:35.110007+0000 0 0 2026-02-17T00:50:45.992 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:50:45.992 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:50:45.993 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:50:46.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-17T00:50:46.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T00:50:46.062 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:50:46.067 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-17T00:50:46.067 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T00:50:46.130 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:50:46.135 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-17T00:50:46.135 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T00:50:46.197 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:50:46.202 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:204: TEST_divergent: echo 'reading divergent objects' 2026-02-17T00:50:46.202 INFO:tasks.workunit.client.0.trial092.stdout:reading divergent objects 2026-02-17T00:50:46.203 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:205: TEST_divergent: ceph pg dump pgs 2026-02-17T00:50:46.426 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:50:46.426 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-17T00:50:26.565500+0000 47'102 51:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:49:13.877511+0000 0'0 2026-02-17T00:49:13.877511+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:03:35.110007+0000 0 0 2026-02-17T00:50:46.426 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:50:46.426 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:50:46.426 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:50:46.434 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: expr 2 + 2 2026-02-17T00:50:46.435 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: seq 1 4 2026-02-17T00:50:46.436 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:50:46.436 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T00:50:46.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:50:46.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T00:50:46.475 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:50:46.476 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T00:50:46.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:50:46.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T00:50:46.512 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rm -f td/divergent-priors/existing 2026-02-17T00:50:46.513 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-17T00:50:46.514 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-17T00:50:46.518 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:50:23.599+0000 7fb049770640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4532.0:1 2026-02-17T00:49:29.882156+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T00:50:46.518 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:50:23.599+0000 7fb049770640 20 _merge_object_divergent_entries: keeping 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4532.0:1 2026-02-17T00:49:29.882156+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T00:50:46.519 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:50:23.599+0000 7fb049770640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:50:46.519 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:50:23.599+0000 7fb049770640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 27'100 first_divergent_update: 27'101 last_divergent_update: 27'101 2026-02-17T00:50:46.519 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:50:23.599+0000 7fb049770640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-17T00:50:46.519 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:50:23.599+0000 7fb049770640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-17T00:50:46.519 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:50:23.599+0000 7fb049770640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 27'101 2026-02-17T00:50:46.519 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:50:23.599+0000 7fb049770640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 27'101 (27'100) modify 1:c156033e:::existing_100:head by client.4532.0:1 2026-02-17T00:49:29.882156+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T00:50:46.519 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:50:23.599+0000 7fb049770640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-17T00:50:46.520 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-17T00:50:46.520 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-17T00:50:46.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:219: TEST_divergent: echo success 2026-02-17T00:50:46.523 INFO:tasks.workunit.client.0.trial092.stdout:success 2026-02-17T00:50:46.524 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: rm -f /tmp/tmp.87SKpC5ILt 2026-02-17T00:50:46.524 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:222: TEST_divergent: delete_pool test 2026-02-17T00:50:46.524 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T00:50:46.524 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T00:50:46.795 INFO:tasks.workunit.client.0.trial092.stderr:pool 'test' does not exist 2026-02-17T00:50:46.803 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: kill_daemons td/divergent-priors 2026-02-17T00:50:46.804 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:50:46.804 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:50:46.804 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:50:46.804 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:50:46.804 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:50:52.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:50:52.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T00:50:52.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T00:50:52.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:50:52.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T00:50:52.117 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:50:52.117 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:50:52.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:50:52.118 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:50:52.118 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:50:52.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:50:52.123 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:50:52.124 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:50:52.124 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:50:52.125 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:50:52.125 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:50:52.126 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:50:52.126 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:50:52.126 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:50:52.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:50:52.127 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:50:52.128 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:50:52.129 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:50:52.129 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T00:50:52.143 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:50:52.143 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:52.143 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:52.143 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44472 2026-02-17T00:50:52.144 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:50:52.144 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:50:52.144 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T00:50:52.144 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T00:50:52.144 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T00:50:52.144 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T00:50:52.144 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T00:50:52.144 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:50:52.144 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T00:50:52.144 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:50:52.144 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:50:52.145 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:50:52.145 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:50:52.145 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:50:52.146 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:50:52.146 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:50:52.147 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:50:52.147 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:50:52.148 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:50:52.148 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:50:52.148 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:50:52.149 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:50:52.149 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:50:52.149 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:50:52.150 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:50:52.150 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:50:52.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:50:52.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T00:50:52.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:50:52.153 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:52.153 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:52.153 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44472 2026-02-17T00:50:52.153 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:50:52.153 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:50:52.153 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T00:50:52.155 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T00:50:52.155 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:52.155 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:52.155 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.44472 2026-02-17T00:50:52.156 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T00:50:52.156 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T00:50:52.156 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T00:50:52.156 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T00:50:52.156 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2026-02-17T00:50:52.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:422: TEST_divergent_2: local dir=td/divergent-priors 2026-02-17T00:50:52.157 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: file_with_random_data 2026-02-17T00:50:52.157 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T00:50:52.157 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T00:50:52.158 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.Ud8hAexMjj 2026-02-17T00:50:52.158 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.Ud8hAexMjj bs=512 count=1 2026-02-17T00:50:52.159 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records in 2026-02-17T00:50:52.159 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records out 2026-02-17T00:50:52.159 INFO:tasks.workunit.client.0.trial092.stderr:512 bytes copied, 6.2667e-05 s, 8.2 MB/s 2026-02-17T00:50:52.159 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.Ud8hAexMjj 2026-02-17T00:50:52.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/tmp/tmp.Ud8hAexMjj 2026-02-17T00:50:52.159 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: file_with_random_data 1000 2026-02-17T00:50:52.159 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-17T00:50:52.160 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T00:50:52.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.MJUanVFfyu 2026-02-17T00:50:52.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.MJUanVFfyu bs=1000 count=1 2026-02-17T00:50:52.161 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records in 2026-02-17T00:50:52.161 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records out 2026-02-17T00:50:52.161 INFO:tasks.workunit.client.0.trial092.stderr:1000 bytes (1.0 kB) copied, 4.5446e-05 s, 22.0 MB/s 2026-02-17T00:50:52.161 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.MJUanVFfyu 2026-02-17T00:50:52.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: local dummyfile2=/tmp/tmp.MJUanVFfyu 2026-02-17T00:50:52.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local num_osds=3 2026-02-17T00:50:52.162 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: expr 3 - 1 2026-02-17T00:50:52.163 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: seq 0 2 2026-02-17T00:50:52.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: local 'osds=0 2026-02-17T00:50:52.164 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:50:52.164 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:50:52.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mon td/divergent-priors a 2026-02-17T00:50:52.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T00:50:52.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T00:50:52.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T00:50:52.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T00:50:52.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T00:50:52.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T00:50:52.184 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T00:50:52.184 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:50:52.184 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:50:52.184 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:50:52.184 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:52.184 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:52.184 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:52.185 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T00:50:52.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T00:50:52.211 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T00:50:52.212 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:50:52.212 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:50:52.212 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T00:50:52.212 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T00:50:52.212 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:50:52.212 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:50:52.212 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:50:52.212 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:50:52.212 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:52.212 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:52.212 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-mon.a.asok 2026-02-17T00:50:52.213 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:50:52.213 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.44472/ceph-mon.a.asok config get fsid 2026-02-17T00:50:52.255 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T00:50:52.255 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:50:52.255 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:50:52.256 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T00:50:52.256 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T00:50:52.256 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:50:52.256 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:50:52.256 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:50:52.256 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:50:52.256 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:52.256 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:52.256 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-mon.a.asok 2026-02-17T00:50:52.256 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:50:52.256 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.44472/ceph-mon.a.asok config get mon_host 2026-02-17T00:50:52.297 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: run_mgr td/divergent-priors x 2026-02-17T00:50:52.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T00:50:52.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T00:50:52.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T00:50:52.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T00:50:52.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T00:50:52.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T00:50:52.403 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T00:50:52.403 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:50:52.403 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:50:52.403 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:50:52.403 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:52.404 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:52.404 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:52.404 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:50:52.404 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 0 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:50:52.424 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T00:50:52.425 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:50:52.425 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=977772d6-e907-41e1-b1c9-ce449dd30a26 2026-02-17T00:50:52.425 INFO:tasks.workunit.client.0.trial092.stdout:add osd0 977772d6-e907-41e1-b1c9-ce449dd30a26 2026-02-17T00:50:52.425 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 977772d6-e907-41e1-b1c9-ce449dd30a26' 2026-02-17T00:50:52.425 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:50:52.439 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBsu5Npy6rIGRAAzoZCTNvgqoe7vqlUQzV+TQ== 2026-02-17T00:50:52.439 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBsu5Npy6rIGRAAzoZCTNvgqoe7vqlUQzV+TQ=="}' 2026-02-17T00:50:52.439 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 977772d6-e907-41e1-b1c9-ce449dd30a26 -i td/divergent-priors/0/new.json 2026-02-17T00:50:52.545 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:50:52.551 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T00:50:52.552 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBsu5Npy6rIGRAAzoZCTNvgqoe7vqlUQzV+TQ== --osd-uuid 977772d6-e907-41e1-b1c9-ce449dd30a26 2026-02-17T00:50:52.572 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:52.565+0000 7f9e88be1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:52.573 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:52.566+0000 7f9e88be1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:52.574 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:52.567+0000 7f9e88be1780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:52.575 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:52.567+0000 7f9e88be1780 -1 bdev(0x3edac00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T00:50:52.575 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:52.567+0000 7f9e88be1780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T00:50:52.959 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T00:50:52.959 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:50:52.959 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T00:50:52.960 INFO:tasks.workunit.client.0.trial092.stdout:adding osd0 key to auth repository 2026-02-17T00:50:52.960 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:50:53.066 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:50:53.068 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T00:50:53.068 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:50:53.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:50:53.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:50:53.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:50:53.085 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:53.078+0000 7fa551a2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:53.086 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:53.079+0000 7fa551a2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:53.087 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:53.080+0000 7fa551a2d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:53.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T00:50:53.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:50:53.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:50:53.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:50:53.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:50:53.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:50:53.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:50:53.170 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:50:53.170 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:50:53.170 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:50:53.271 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:50:53.276 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:53.269+0000 7fa551a2d780 -1 Falling back to public interface 2026-02-17T00:50:53.630 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:53.622+0000 7fa551a2d780 -1 osd.0 0 log_to_monitors true 2026-02-17T00:50:54.272 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:50:54.273 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:50:54.273 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:50:54.274 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:50:54.274 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:50:54.275 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:50:54.371 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4158610200,v1:127.0.0.1:6801/4158610200] [v2:127.0.0.1:6802/4158610200,v1:127.0.0.1:6803/4158610200] exists,up 977772d6-e907-41e1-b1c9-ce449dd30a26 2026-02-17T00:50:54.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:50:54.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:50:54.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:50:54.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-17T00:50:54.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 1 2026-02-17T00:50:54.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:50:54.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:50:54.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T00:50:54.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:50:54.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:50:54.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:50:54.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:50:54.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:50:54.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:50:54.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:50:54.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:50:54.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:50:54.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:50:54.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:50:54.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:50:54.374 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:50:54.375 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=e3a77d41-a7b1-4813-9488-a1b9bb60be11 2026-02-17T00:50:54.375 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 e3a77d41-a7b1-4813-9488-a1b9bb60be11' 2026-02-17T00:50:54.375 INFO:tasks.workunit.client.0.trial092.stdout:add osd1 e3a77d41-a7b1-4813-9488-a1b9bb60be11 2026-02-17T00:50:54.375 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:50:54.387 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBuu5NpEgzBFhAA1DE9fzsXuQKJkeBcNuCP0g== 2026-02-17T00:50:54.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBuu5NpEgzBFhAA1DE9fzsXuQKJkeBcNuCP0g=="}' 2026-02-17T00:50:54.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new e3a77d41-a7b1-4813-9488-a1b9bb60be11 -i td/divergent-priors/1/new.json 2026-02-17T00:50:54.495 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:50:54.501 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T00:50:54.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBuu5NpEgzBFhAA1DE9fzsXuQKJkeBcNuCP0g== --osd-uuid e3a77d41-a7b1-4813-9488-a1b9bb60be11 2026-02-17T00:50:54.521 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:54.513+0000 7fc30eddd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:54.522 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:54.515+0000 7fc30eddd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:54.523 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:54.516+0000 7fc30eddd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:54.523 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:54.516+0000 7fc30eddd780 -1 bdev(0x298ec00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T00:50:54.524 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:54.516+0000 7fc30eddd780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T00:50:54.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T00:50:54.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:50:54.855 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T00:50:54.855 INFO:tasks.workunit.client.0.trial092.stdout:adding osd1 key to auth repository 2026-02-17T00:50:54.855 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:50:55.170 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T00:50:55.171 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:50:55.171 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:50:55.171 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:50:55.171 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:50:55.171 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:50:55.188 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:55.181+0000 7f955b02c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:55.190 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:55.183+0000 7f955b02c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:55.191 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:55.184+0000 7f955b02c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:55.326 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:55.318+0000 7f955b02c780 -1 Falling back to public interface 2026-02-17T00:50:55.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T00:50:55.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:50:55.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:50:55.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:50:55.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:50:55.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:50:55.402 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:50:55.402 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:50:55.402 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:50:55.402 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:50:55.627 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:55.620+0000 7f955b02c780 -1 osd.1 0 log_to_monitors true 2026-02-17T00:50:55.627 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:50:56.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:50:56.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:50:56.629 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:50:56.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:50:56.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:50:56.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:50:56.860 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3245503761,v1:127.0.0.1:6811/3245503761] [v2:127.0.0.1:6812/3245503761,v1:127.0.0.1:6813/3245503761] exists,up e3a77d41-a7b1-4813-9488-a1b9bb60be11 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 2 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:50:56.861 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:50:56.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T00:50:56.863 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:50:56.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=10379749-15c0-4a15-8266-d3fffe22e6fe 2026-02-17T00:50:56.864 INFO:tasks.workunit.client.0.trial092.stdout:add osd2 10379749-15c0-4a15-8266-d3fffe22e6fe 2026-02-17T00:50:56.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 10379749-15c0-4a15-8266-d3fffe22e6fe' 2026-02-17T00:50:56.864 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:50:56.877 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBwu5Npw/bkMxAAwSUz4Uf/d0lk2cvLPtT1Rg== 2026-02-17T00:50:56.877 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBwu5Npw/bkMxAAwSUz4Uf/d0lk2cvLPtT1Rg=="}' 2026-02-17T00:50:56.877 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 10379749-15c0-4a15-8266-d3fffe22e6fe -i td/divergent-priors/2/new.json 2026-02-17T00:50:57.109 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T00:50:57.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T00:50:57.118 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBwu5Npw/bkMxAAwSUz4Uf/d0lk2cvLPtT1Rg== --osd-uuid 10379749-15c0-4a15-8266-d3fffe22e6fe 2026-02-17T00:50:57.139 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:57.131+0000 7fae13056780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:57.140 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:57.133+0000 7fae13056780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:57.141 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:57.134+0000 7fae13056780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:57.141 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:57.134+0000 7fae13056780 -1 bdev(0x253ac00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T00:50:57.141 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:57.134+0000 7fae13056780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T00:50:57.447 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T00:50:57.447 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:50:57.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T00:50:57.448 INFO:tasks.workunit.client.0.trial092.stdout:adding osd2 key to auth repository 2026-02-17T00:50:57.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:50:57.767 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:50:57.768 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T00:50:57.768 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:50:57.768 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:50:57.768 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:50:57.768 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:50:57.787 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:57.780+0000 7f814ca2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:57.788 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:57.782+0000 7f814ca2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:57.789 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:57.782+0000 7f814ca2c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:50:57.910 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:57.903+0000 7f814ca2c780 -1 Falling back to public interface 2026-02-17T00:50:57.993 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T00:50:57.993 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:50:57.993 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:50:57.993 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:50:57.993 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:50:57.993 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:50:57.994 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:50:57.994 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:50:57.994 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:50:57.994 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:50:58.179 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:50:58.171+0000 7f814ca2c780 -1 osd.2 0 log_to_monitors true 2026-02-17T00:50:58.239 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:50:59.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:50:59.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:50:59.241 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:50:59.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:50:59.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:50:59.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:50:59.471 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/929962877,v1:127.0.0.1:6819/929962877] [v2:127.0.0.1:6820/929962877,v1:127.0.0.1:6821/929962877] exists,up 10379749-15c0-4a15-8266-d3fffe22e6fe 2026-02-17T00:50:59.471 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:50:59.471 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:50:59.471 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:50:59.471 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noout 2026-02-17T00:50:59.755 INFO:tasks.workunit.client.0.trial092.stderr:noout is set 2026-02-17T00:50:59.764 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set noin 2026-02-17T00:51:00.059 INFO:tasks.workunit.client.0.trial092.stderr:noin is set 2026-02-17T00:51:00.068 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: ceph osd set nodown 2026-02-17T00:51:00.362 INFO:tasks.workunit.client.0.trial092.stderr:nodown is set 2026-02-17T00:51:00.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: create_pool test 1 1 2026-02-17T00:51:00.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T00:51:00.629 INFO:tasks.workunit.client.0.trial092.stderr:pool 'test' already exists 2026-02-17T00:51:00.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T00:51:01.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test size 3 2026-02-17T00:51:01.959 INFO:tasks.workunit.client.0.trial092.stderr:set pool 1 size to 3 2026-02-17T00:51:01.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:442: TEST_divergent_2: ceph osd pool set test min_size 2 2026-02-17T00:51:02.263 INFO:tasks.workunit.client.0.trial092.stderr:set pool 1 min_size to 2 2026-02-17T00:51:02.272 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: flush_pg_stats 2026-02-17T00:51:02.273 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:51:02.273 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:51:02.504 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:51:02.504 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:51:02.504 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:51:02.504 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:51:02.504 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:02.504 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:51:02.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-17T00:51:02.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-17T00:51:02.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-17T00:51:02.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:02.571 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:51:02.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672964 2026-02-17T00:51:02.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672964 2026-02-17T00:51:02.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-42949672964' 2026-02-17T00:51:02.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:02.640 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:51:02.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T00:51:02.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T00:51:02.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-42949672964 2-60129542147' 2026-02-17T00:51:02.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:51:02.707 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-17T00:51:02.707 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:51:02.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:51:02.708 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-17T00:51:02.709 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:51:02.710 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-17T00:51:02.710 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-17T00:51:02.710 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836484 2026-02-17T00:51:02.710 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:51:02.943 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T00:51:02.943 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:51:03.944 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:51:03.944 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:51:04.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T00:51:04.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:51:05.174 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T00:51:05.174 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:51:05.408 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-17T00:51:05.408 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:51:05.408 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672964 2026-02-17T00:51:05.408 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:51:05.409 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:51:05.410 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672964 2026-02-17T00:51:05.410 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:51:05.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672964 2026-02-17T00:51:05.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672964' 2026-02-17T00:51:05.411 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 42949672964 2026-02-17T00:51:05.411 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:51:05.651 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672964 -lt 42949672964 2026-02-17T00:51:05.652 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:51:05.652 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T00:51:05.652 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:51:05.653 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:51:05.653 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T00:51:05.654 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:51:05.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T00:51:05.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T00:51:05.655 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 60129542147 2026-02-17T00:51:05.655 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:51:05.887 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542147 2026-02-17T00:51:05.887 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:445: TEST_divergent_2: wait_for_clean 2026-02-17T00:51:05.887 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:51:05.888 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:51:05.888 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:51:05.888 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T00:51:05.888 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:51:05.889 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:51:05.889 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:51:05.889 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:51:05.889 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:51:05.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T00:51:05.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:51:05.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:51:05.972 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:51:05.972 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:51:05.972 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:51:06.201 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:51:06.201 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:51:06.201 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:51:06.201 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:51:06.201 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:06.201 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:51:06.272 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T00:51:06.272 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T00:51:06.273 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T00:51:06.273 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:06.273 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:51:06.341 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672966 2026-02-17T00:51:06.341 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672966 2026-02-17T00:51:06.341 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966' 2026-02-17T00:51:06.341 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:06.341 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:51:06.408 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T00:51:06.408 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T00:51:06.408 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-42949672966 2-60129542150' 2026-02-17T00:51:06.408 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:51:06.408 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T00:51:06.409 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:51:06.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:51:06.410 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T00:51:06.410 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:51:06.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T00:51:06.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T00:51:06.411 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836487 2026-02-17T00:51:06.411 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:51:06.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T00:51:06.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:51:06.639 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672966 2026-02-17T00:51:06.639 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:51:06.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:51:06.640 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672966 2026-02-17T00:51:06.640 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:51:06.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672966 2026-02-17T00:51:06.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672966' 2026-02-17T00:51:06.641 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 42949672966 2026-02-17T00:51:06.641 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:51:06.868 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672966 -lt 42949672966 2026-02-17T00:51:06.868 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:51:06.868 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T00:51:06.868 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:51:06.869 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:51:06.870 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T00:51:06.870 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:51:06.871 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T00:51:06.871 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T00:51:06.871 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 60129542150 2026-02-17T00:51:06.871 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:51:07.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T00:51:07.104 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:51:07.104 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:07.104 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:07.419 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:51:07.419 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:51:07.420 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:51:07.420 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:51:07.420 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:51:07.420 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:51:07.420 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:51:07.420 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:51:07.643 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T00:51:07.643 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:51:07.643 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:07.643 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:07.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T00:51:07.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T00:51:07.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T00:51:07.974 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: ceph pg dump pgs --format=json 2026-02-17T00:51:07.975 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2026-02-17T00:51:08.193 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:51:08.201 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: local divergent=1 2026-02-17T00:51:08.201 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2026-02-17T00:51:08.201 INFO:tasks.workunit.client.0.trial092.stdout:primary and soon to be divergent is 1 2026-02-17T00:51:08.201 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:51:08.418 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:51:08.418 INFO:tasks.workunit.client.0.trial092.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T00:51:01.246786+0000 0'0 28:20 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T06:13:39.781570+0000 0 0 2026-02-17T00:51:08.418 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:51:08.418 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:51:08.419 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:51:08.425 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: local non_divergent= 2026-02-17T00:51:08.425 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-17T00:51:08.425 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 0 = 1 ']' 2026-02-17T00:51:08.426 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0' 2026-02-17T00:51:08.426 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-17T00:51:08.426 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 1 = 1 ']' 2026-02-17T00:51:08.426 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:455: TEST_divergent_2: continue 2026-02-17T00:51:08.426 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-17T00:51:08.426 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 2 = 1 ']' 2026-02-17T00:51:08.426 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0 2' 2026-02-17T00:51:08.426 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:460: TEST_divergent_2: echo 'writing initial objects' 2026-02-17T00:51:08.426 INFO:tasks.workunit.client.0.trial092.stdout:writing initial objects 2026-02-17T00:51:08.427 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: seq 1 100 2026-02-17T00:51:08.427 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.427 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.446 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.446 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.465 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.465 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_3 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.484 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.484 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_5 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.521 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.521 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_6 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.540 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.540 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_7 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_8 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.576 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.576 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_9 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.594 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.594 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_10 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_11 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_12 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.647 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.647 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_13 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.666 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_14 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.684 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.684 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_15 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.702 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.702 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_16 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.722 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.722 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_17 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_18 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_19 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.777 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.777 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_20 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.796 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.796 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_21 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.814 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.814 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_22 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_23 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_24 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.871 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.871 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_25 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.891 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.891 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_26 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_27 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.927 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.927 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_28 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_29 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.963 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.964 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_30 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:08.983 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:08.983 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_31 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.002 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.002 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_32 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.020 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_33 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.039 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_34 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.057 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.057 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_35 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.074 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.074 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_36 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_37 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_38 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.130 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.130 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_39 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.149 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.149 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_40 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_41 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_42 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.206 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.206 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_43 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_44 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.243 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.243 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_45 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_46 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.279 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.279 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_47 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_48 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.317 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.317 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_49 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_50 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.354 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.354 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_51 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_52 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.391 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.392 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_53 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.409 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_54 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.428 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.428 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_55 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_56 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.467 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.467 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_57 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.486 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.486 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_58 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_59 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.523 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.523 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_60 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.542 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.542 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_61 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_62 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.579 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.580 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_63 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.598 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.598 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_64 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.617 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.617 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_65 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_66 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_67 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_68 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.692 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.692 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_69 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.711 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.711 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_70 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.730 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.731 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_71 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_72 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.767 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.767 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_73 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.785 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.785 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_74 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.804 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.804 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_75 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.823 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.823 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_76 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.842 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.842 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_77 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_78 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.879 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.879 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_79 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.898 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.898 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_80 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.917 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.917 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_81 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_82 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.955 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.955 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_83 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_84 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:09.991 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:09.992 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_85 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_86 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.029 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.029 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_87 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.048 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.049 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_88 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.067 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.067 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_89 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.086 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.086 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_90 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_91 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.123 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_92 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.141 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.141 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_93 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_94 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.178 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_95 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.197 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.197 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_96 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_97 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.235 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.235 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_98 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.253 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.253 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_99 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.272 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T00:51:10.272 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_100 /tmp/tmp.Ud8hAexMjj 2026-02-17T00:51:10.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T00:51:10.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: wait_for_clean 2026-02-17T00:51:10.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:51:10.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:51:10.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:51:10.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T00:51:10.291 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:51:10.292 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:51:10.292 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:51:10.292 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:51:10.292 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:51:10.342 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T00:51:10.342 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:51:10.342 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:51:10.342 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:51:10.342 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:51:10.342 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:51:10.577 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:51:10.577 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:51:10.577 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:51:10.577 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:51:10.578 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:10.578 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:51:10.645 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-17T00:51:10.645 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-17T00:51:10.645 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T00:51:10.645 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:10.645 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:51:10.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=42949672969 2026-02-17T00:51:10.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 42949672969 2026-02-17T00:51:10.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672969' 2026-02-17T00:51:10.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:10.715 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:51:10.782 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T00:51:10.782 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T00:51:10.782 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-42949672969 2-60129542153' 2026-02-17T00:51:10.782 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:51:10.783 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-17T00:51:10.783 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:51:10.783 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:51:10.785 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-17T00:51:10.785 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:51:10.786 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-17T00:51:10.786 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T00:51:10.786 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836490 2026-02-17T00:51:10.787 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:51:11.014 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-17T00:51:11.014 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:51:12.014 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:51:12.014 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:51:12.244 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-17T00:51:12.244 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:51:13.246 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T00:51:13.246 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:51:13.475 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-17T00:51:13.475 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:51:13.476 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-42949672969 2026-02-17T00:51:13.476 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:51:13.477 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:51:13.477 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-42949672969 2026-02-17T00:51:13.478 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:51:13.479 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=42949672969 2026-02-17T00:51:13.479 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 42949672969' 2026-02-17T00:51:13.479 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 42949672969 2026-02-17T00:51:13.480 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:51:13.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 42949672970 -lt 42949672969 2026-02-17T00:51:13.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:51:13.721 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T00:51:13.721 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:51:13.722 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:51:13.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T00:51:13.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:51:13.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T00:51:13.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T00:51:13.724 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 60129542153 2026-02-17T00:51:13.724 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:51:13.956 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T00:51:13.956 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:51:13.956 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:13.956 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:14.276 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:51:14.277 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:51:14.277 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:51:14.277 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:51:14.277 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:51:14.277 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:51:14.277 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:51:14.277 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:51:14.503 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T00:51:14.503 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:51:14.503 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:14.504 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:14.827 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T00:51:14.827 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T00:51:14.827 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T00:51:14.827 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: get_pg test existing_1 2026-02-17T00:51:14.827 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T00:51:14.827 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T00:51:14.828 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T00:51:14.828 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T00:51:15.063 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: local pgid=1.0 2026-02-17T00:51:15.063 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: echo 'blackholing osds 0 2' 2026-02-17T00:51:15.063 INFO:tasks.workunit.client.0.trial092.stdout:blackholing osds 0 2 2026-02-17T00:51:15.063 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:51:15.286 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:51:15.286 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T00:51:01.246786+0000 28'100 28:120 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T06:13:39.781570+0000 0 0 2026-02-17T00:51:15.286 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:51:15.286 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:51:15.286 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:51:15.293 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-17T00:51:15.293 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.0 2026-02-17T00:51:15.294 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T00:51:15.294 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T00:51:15.294 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:51:15.294 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:51:15.294 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:51:15.294 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.0.asok 2026-02-17T00:51:15.295 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-17T00:51:15.295 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T00:51:15.338 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:51:15.338 INFO:tasks.workunit.client.0.trial092.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T00:51:15.338 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:51:15.342 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-17T00:51:15.342 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.2 2026-02-17T00:51:15.342 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T00:51:15.342 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T00:51:15.343 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:51:15.343 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:51:15.343 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:51:15.343 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.2.asok 2026-02-17T00:51:15.343 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-17T00:51:15.343 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T00:51:15.386 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:51:15.386 INFO:tasks.workunit.client.0.trial092.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T00:51:15.386 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:51:15.392 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: echo 'create new divergent objects' 2026-02-17T00:51:15.392 INFO:tasks.workunit.client.0.trial092.stdout:create new divergent objects 2026-02-17T00:51:15.392 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: seq 1 2 2026-02-17T00:51:15.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T00:51:15.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T00:51:15.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_1 2026-02-17T00:51:15.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: echo 'writing divergent objects' 2026-02-17T00:51:15.393 INFO:tasks.workunit.client.0.trial092.stdout:writing divergent objects 2026-02-17T00:51:15.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_2 2026-02-17T00:51:15.393 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: seq 1 2 2026-02-17T00:51:15.394 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T00:51:15.394 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T00:51:15.394 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.MJUanVFfyu 2026-02-17T00:51:15.395 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: echo 'remove divergent objects' 2026-02-17T00:51:15.395 INFO:tasks.workunit.client.0.trial092.stdout:remove divergent objects 2026-02-17T00:51:15.395 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.MJUanVFfyu 2026-02-17T00:51:15.395 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: seq 1 2 2026-02-17T00:51:15.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T00:51:15.396 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 1 + 2 2026-02-17T00:51:15.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=3 2026-02-17T00:51:15.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T00:51:15.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_3 2026-02-17T00:51:15.397 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 2 + 2 2026-02-17T00:51:15.398 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=4 2026-02-17T00:51:15.398 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: sleep 10 2026-02-17T00:51:15.399 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_4 2026-02-17T00:51:25.400 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:499: TEST_divergent_2: killall -9 rados 2026-02-17T00:51:25.433 INFO:tasks.workunit.client.0.trial092.stderr:rados: no process found 2026-02-17T00:51:25.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: echo 'killing all the osds' 2026-02-17T00:51:25.433 INFO:tasks.workunit.client.0.trial092.stdout:killing all the osds 2026-02-17T00:51:25.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:51:25.653 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:51:25.654 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-17T00:51:01.246786+0000 28'106 28:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T06:13:39.781570+0000 0 0 2026-02-17T00:51:25.654 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:51:25.654 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:51:25.654 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:51:25.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2026-02-17T00:51:25.662 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:51:25.662 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:51:25.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:51:25.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:51:25.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:51:25.769 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:51:25.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-17T00:51:25.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.0 2026-02-17T00:51:26.051 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already down. 2026-02-17T00:51:26.059 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-17T00:51:26.059 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.1 2026-02-17T00:51:26.341 INFO:tasks.workunit.client.0.trial092.stderr:osd.1 is already down. 2026-02-17T00:51:26.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-17T00:51:26.350 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.2 2026-02-17T00:51:26.645 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already down. 2026-02-17T00:51:26.653 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-17T00:51:26.653 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.0 2026-02-17T00:51:26.932 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already out. 2026-02-17T00:51:26.939 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-17T00:51:26.939 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.2 2026-02-17T00:51:27.220 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already out. 2026-02-17T00:51:27.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2026-02-17T00:51:27.228 INFO:tasks.workunit.client.0.trial092.stdout:bringing up non_divergent 0 2 2026-02-17T00:51:27.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:51:27.446 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:51:27.446 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-17T00:51:01.246786+0000 28'106 28:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T06:13:39.781570+0000 0 0 2026-02-17T00:51:27.446 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:51:27.447 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:51:27.447 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 0 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T00:51:27.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:51:27.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:51:27.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:51:27.455 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:51:27.455 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:51:27.455 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:51:27.455 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:51:27.455 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:51:27.455 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:51:27.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:51:27.457 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T00:51:27.457 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T00:51:27.457 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:51:27.458 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:51:27.458 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:51:27.475 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:51:27.469+0000 7fb162073780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:51:27.478 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:51:27.472+0000 7fb162073780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:51:27.479 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:51:27.473+0000 7fb162073780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:51:27.656 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:51:27.649+0000 7fb162073780 -1 Falling back to public interface 2026-02-17T00:51:27.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T00:51:27.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:51:27.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:51:27.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:51:27.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:51:27.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:51:27.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:51:27.691 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:51:27.691 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:51:27.691 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:51:27.932 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:51:27.966 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:51:27.960+0000 7fb162073780 -1 osd.0 28 log_to_monitors true 2026-02-17T00:51:28.934 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:51:28.934 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:51:28.934 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:51:28.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:51:28.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:51:28.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:51:29.164 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/2478527939,v1:127.0.0.1:6801/2478527939] [v2:127.0.0.1:6802/2478527939,v1:127.0.0.1:6803/2478527939] exists,up 977772d6-e907-41e1-b1c9-ce449dd30a26 2026-02-17T00:51:29.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:51:29.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:51:29.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:51:29.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-17T00:51:29.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 2 2026-02-17T00:51:29.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:51:29.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:51:29.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:51:29.166 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:51:29.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:51:29.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:51:29.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:51:29.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:51:29.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:51:29.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:51:29.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:51:29.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:51:29.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:51:29.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:51:29.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T00:51:29.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T00:51:29.168 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:51:29.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:51:29.168 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T00:51:29.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T00:51:29.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:51:29.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:51:29.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:51:29.187 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:51:29.180+0000 7ff48825f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:51:29.188 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:51:29.182+0000 7ff48825f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:51:29.189 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:51:29.183+0000 7ff48825f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:51:29.313 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:51:29.306+0000 7ff48825f780 -1 Falling back to public interface 2026-02-17T00:51:29.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T00:51:29.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:51:29.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:51:29.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:51:29.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:51:29.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:51:29.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:51:29.396 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:51:29.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:51:29.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:51:29.626 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:51:29.648 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:51:29.642+0000 7ff48825f780 -1 osd.2 28 log_to_monitors true 2026-02-17T00:51:30.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:51:30.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:51:30.628 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:51:30.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:51:30.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:51:30.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:51:30.859 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up out weight 0 up_from 37 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/314318210,v1:127.0.0.1:6811/314318210] [v2:127.0.0.1:6812/314318210,v1:127.0.0.1:6813/314318210] exists,up 10379749-15c0-4a15-8266-d3fffe22e6fe 2026-02-17T00:51:30.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:51:30.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:51:30.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:51:30.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-17T00:51:30.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.0 2026-02-17T00:51:31.108 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already in. 2026-02-17T00:51:31.115 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-17T00:51:31.115 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.2 2026-02-17T00:51:31.396 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already in. 2026-02-17T00:51:31.404 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T00:51:31.404 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: wait_for_clean 2026-02-17T00:51:31.404 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:51:31.404 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:51:31.404 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:51:31.404 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T00:51:31.405 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:51:31.405 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:51:31.405 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:51:31.405 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:51:31.405 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:51:31.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T00:51:31.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:51:31.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:51:31.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:51:31.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:51:31.457 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:51:31.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:51:31.688 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:51:31.689 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:51:31.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:51:31.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:31.689 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:51:31.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-17T00:51:31.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-17T00:51:31.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363' 2026-02-17T00:51:31.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:31.758 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:51:31.807 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T00:51:31.807 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T00:51:31.808 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T00:51:31.808 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T00:51:31.808 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:51:31.808 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:51:31.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-17T00:51:31.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-17T00:51:31.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 2-158913789955' 2026-02-17T00:51:31.875 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:51:31.876 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855363 2026-02-17T00:51:31.876 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:51:31.876 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:51:31.877 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-17T00:51:31.877 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:51:31.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-17T00:51:31.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-17T00:51:31.878 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 150323855363 2026-02-17T00:51:31.878 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:51:32.120 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-17T00:51:32.120 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:51:33.121 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:51:33.122 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:51:33.352 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-17T00:51:33.352 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:51:33.352 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789955 2026-02-17T00:51:33.353 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:51:33.353 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:51:33.354 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789955 2026-02-17T00:51:33.354 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:51:33.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789955 2026-02-17T00:51:33.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789955' 2026-02-17T00:51:33.355 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 158913789955 2026-02-17T00:51:33.355 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:51:33.598 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789955 -lt 158913789955 2026-02-17T00:51:33.599 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:51:33.599 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:33.599 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:33.915 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:51:33.915 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:51:33.916 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:51:33.916 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:51:33.916 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:51:33.916 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:51:33.916 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:51:33.916 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:51:34.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:51:34.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:51:34.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:34.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:34.470 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:51:34.470 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T00:51:34.470 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T00:51:34.470 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T00:51:34.470 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:51:34.471 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T00:51:34.573 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:51:34.573 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:51:34.573 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:51:34.574 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:51:34.574 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:51:34.574 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:51:34.574 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:51:34.574 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:51:34.809 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:51:34.810 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:51:34.810 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:34.810 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:35.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:51:35.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:51:35.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:51:35.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:51:35.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:51:35.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:51:35.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:51:35.135 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:51:35.135 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:51:35.464 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:51:35.465 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:51:35.465 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T00:51:35.465 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:51:35.465 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T00:51:35.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:51:35.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:51:35.666 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:51:35.666 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:51:35.666 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:51:35.666 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:51:35.666 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:51:35.666 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:51:35.894 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:51:35.894 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:51:35.894 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:35.894 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:36.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:51:36.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:51:36.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:51:36.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:51:36.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:51:36.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:51:36.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:51:36.229 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:51:36.229 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:51:36.545 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:51:36.545 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:51:36.545 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T00:51:36.545 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:51:36.545 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T00:51:36.947 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:51:36.947 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:51:36.947 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:51:36.947 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:51:36.947 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:51:36.947 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:51:36.948 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:51:36.948 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:51:37.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:51:37.174 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:51:37.174 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:37.174 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:37.493 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:51:37.493 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:51:37.493 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:51:37.493 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:51:37.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:51:37.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:51:37.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:51:37.494 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:51:37.494 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:51:37.818 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:51:37.818 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:51:37.818 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T00:51:37.818 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:51:37.818 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T00:51:38.619 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:51:38.619 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:51:38.620 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:51:38.620 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:51:38.620 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:51:38.620 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:51:38.620 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:51:38.621 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:51:38.857 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:51:38.857 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:51:38.858 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:38.858 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:39.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:51:39.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:51:39.187 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:51:39.187 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:51:39.187 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:51:39.187 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:51:39.187 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:51:39.187 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:51:39.187 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:51:39.515 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:51:39.516 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:51:39.516 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T00:51:39.516 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:51:39.516 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T00:51:41.116 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:51:41.116 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:51:41.116 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:51:41.116 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:51:41.116 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:51:41.116 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:51:41.117 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:51:41.117 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:51:41.355 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:51:41.356 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:51:41.356 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:41.356 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:41.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:51:41.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:51:41.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:51:41.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:51:41.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:51:41.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:51:41.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:51:41.677 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:51:41.677 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:51:41.994 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:51:41.994 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:51:41.994 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T00:51:41.994 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:51:41.994 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T00:51:45.195 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:51:45.196 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:51:45.196 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:51:45.196 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:51:45.196 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:51:45.196 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:51:45.196 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:51:45.197 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:51:45.431 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:51:45.431 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:51:45.432 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:45.432 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:45.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:51:45.752 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:51:45.752 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:51:45.752 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:51:45.752 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:51:45.752 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:51:45.752 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:51:45.752 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:51:45.752 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:51:46.076 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:51:46.076 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:51:46.076 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T00:51:46.076 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:51:46.076 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T00:51:52.476 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:51:52.476 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:51:52.477 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:51:52.477 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:51:52.477 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:51:52.477 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:51:52.478 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:51:52.478 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:51:52.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:51:52.703 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:51:52.703 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:51:52.703 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:51:53.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:51:53.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:51:53.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:51:53.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:51:53.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:51:53.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:51:53.020 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:51:53.020 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:51:53.020 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:51:53.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:51:53.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:51:53.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T00:51:53.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:51:53.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T00:52:00.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:52:00.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:52:00.637 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:52:00.637 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:52:00.637 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:52:00.637 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:52:00.637 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:52:00.638 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:52:00.863 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:52:00.863 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:52:00.863 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:52:00.864 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:52:01.183 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:52:01.183 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:52:01.183 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:52:01.183 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:52:01.183 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:52:01.183 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:52:01.184 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:52:01.184 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:52:01.184 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:52:01.501 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:52:01.501 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:52:01.501 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T00:52:01.501 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T00:52:01.817 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:52:01.817 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_fingerprint": "a7405210-f3ca-42ed-9c5d-3d93b8b7e99d", 2026-02-17T00:52:01.817 INFO:tasks.workunit.client.0.trial092.stdout: "version": "20.3.0-5225-g03ef619e", 2026-02-17T00:52:01.817 INFO:tasks.workunit.client.0.trial092.stdout: "commit": "03ef619e79a56cd363b087a5c6f19a1a09b49040", 2026-02-17T00:52:01.817 INFO:tasks.workunit.client.0.trial092.stdout: "timestamp": "2026-02-17T00:52:01.811955+0000", 2026-02-17T00:52:01.817 INFO:tasks.workunit.client.0.trial092.stdout: "tag": "", 2026-02-17T00:52:01.818 INFO:tasks.workunit.client.0.trial092.stdout: "health": { 2026-02-17T00:52:01.818 INFO:tasks.workunit.client.0.trial092.stdout: "status": "HEALTH_WARN", 2026-02-17T00:52:01.818 INFO:tasks.workunit.client.0.trial092.stdout: "checks": { 2026-02-17T00:52:01.818 INFO:tasks.workunit.client.0.trial092.stdout: "OSDMAP_FLAGS": { 2026-02-17T00:52:01.818 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:52:01.818 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:52:01.818 INFO:tasks.workunit.client.0.trial092.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T00:52:01.818 INFO:tasks.workunit.client.0.trial092.stdout: "count": 17 2026-02-17T00:52:01.818 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [], 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: "OSD_DOWN": { 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: "message": "1 osds down", 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: "count": 1 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.819 INFO:tasks.workunit.client.0.trial092.stdout: "message": "osd.1 (root=default,host=trial092) is down" 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: "PG_DEGRADED": { 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: "count": 1 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:52:01.820 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.821 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:52:01.821 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.821 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.821 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:52:01.821 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.821 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.821 INFO:tasks.workunit.client.0.trial092.stdout: "mutes": [] 2026-02-17T00:52:01.821 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.821 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_first_committed": 1, 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_last_committed": 1, 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "monmap": { 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:50:52.172246Z", 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:50:52.172246Z", 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release": 20, 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release_name": "tentacle", 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "election_strategy": 1, 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "disallowed_leaders": "", 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": false, 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "tiebreaker_mon": "", 2026-02-17T00:52:01.822 INFO:tasks.workunit.client.0.trial092.stdout: "removed_ranks": "", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "features": { 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "persistent": [ 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "kraken", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "luminous", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "mimic", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap-prune", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "nautilus", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "octopus", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "pacific", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "elector-pinging", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "quincy", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "reef", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "squid", 2026-02-17T00:52:01.823 INFO:tasks.workunit.client.0.trial092.stdout: "tentacle", 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: "nvmeof_beacon_diff" 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: "optional": [] 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: "mons": [ 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: "rank": 0, 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: "name": "a", 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115", 2026-02-17T00:52:01.824 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 0 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: "priority": 0, 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 0, 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: "time_added": "2026-02-17T00:50:52:172242+0000", 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: "crush_location": [] 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: "quorum": [ 2026-02-17T00:52:01.825 INFO:tasks.workunit.client.0.trial092.stdout: 0 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap": { 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 40, 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:50:52.206521+0000", 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:51:31.426619+0000", 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "last_up_change": "2026-02-17T00:51:29.803880+0000", 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "last_in_change": "2026-02-17T00:51:31.324676+0000", 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "flags_num": 5800384, 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "flags_set": [ 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "nodown", 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "noin", 2026-02-17T00:52:01.826 INFO:tasks.workunit.client.0.trial092.stdout: "noout", 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "pglog_hardlimit", 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snapdirs", 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "recovery_deletes", 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "sortbitwise" 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "crush_version": 9, 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_snapshot": "", 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "pool_max": 1, 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "max_osd": 3, 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "require_min_compat_client": "luminous", 2026-02-17T00:52:01.827 INFO:tasks.workunit.client.0.trial092.stdout: "min_compat_client": "jewel", 2026-02-17T00:52:01.828 INFO:tasks.workunit.client.0.trial092.stdout: "require_osd_release": "tentacle", 2026-02-17T00:52:01.828 INFO:tasks.workunit.client.0.trial092.stdout: "allow_crimson": false, 2026-02-17T00:52:01.828 INFO:tasks.workunit.client.0.trial092.stdout: "pools": [ 2026-02-17T00:52:01.828 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.828 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:52:01.828 INFO:tasks.workunit.client.0.trial092.stdout: "pool_name": "test", 2026-02-17T00:52:01.828 INFO:tasks.workunit.client.0.trial092.stdout: "create_time": "2026-02-17T00:51:00.531303+0000", 2026-02-17T00:52:01.828 INFO:tasks.workunit.client.0.trial092.stdout: "flags": 1, 2026-02-17T00:52:01.828 INFO:tasks.workunit.client.0.trial092.stdout: "flags_names": "hashpspool", 2026-02-17T00:52:01.828 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:52:01.828 INFO:tasks.workunit.client.0.trial092.stdout: "size": 3, 2026-02-17T00:52:01.829 INFO:tasks.workunit.client.0.trial092.stdout: "min_size": 2, 2026-02-17T00:52:01.829 INFO:tasks.workunit.client.0.trial092.stdout: "crush_rule": 0, 2026-02-17T00:52:01.829 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_count": 0, 2026-02-17T00:52:01.829 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_target": 0, 2026-02-17T00:52:01.829 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T00:52:01.829 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T00:52:01.829 INFO:tasks.workunit.client.0.trial092.stdout: "is_stretch_pool": false, 2026-02-17T00:52:01.829 INFO:tasks.workunit.client.0.trial092.stdout: "object_hash": 2, 2026-02-17T00:52:01.829 INFO:tasks.workunit.client.0.trial092.stdout: "pg_autoscale_mode": "off", 2026-02-17T00:52:01.829 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num": 1, 2026-02-17T00:52:01.829 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num": 1, 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num_target": 1, 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_target": 1, 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_pending": 1, 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: "last_pg_merge_meta": { 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: "source_pgid": "0.0", 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: "ready_epoch": 0, 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_started": 0, 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": 0, 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: "source_version": "0'0", 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: "target_version": "0'0" 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.830 INFO:tasks.workunit.client.0.trial092.stdout: "last_change": "28", 2026-02-17T00:52:01.831 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend": "0", 2026-02-17T00:52:01.831 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T00:52:01.831 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T00:52:01.831 INFO:tasks.workunit.client.0.trial092.stdout: "auid": 0, 2026-02-17T00:52:01.831 INFO:tasks.workunit.client.0.trial092.stdout: "snap_mode": "selfmanaged", 2026-02-17T00:52:01.831 INFO:tasks.workunit.client.0.trial092.stdout: "snap_seq": 0, 2026-02-17T00:52:01.831 INFO:tasks.workunit.client.0.trial092.stdout: "snap_epoch": 0, 2026-02-17T00:52:01.831 INFO:tasks.workunit.client.0.trial092.stdout: "pool_snaps": [], 2026-02-17T00:52:01.831 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps": "[]", 2026-02-17T00:52:01.831 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_bytes": 0, 2026-02-17T00:52:01.831 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_objects": 0, 2026-02-17T00:52:01.832 INFO:tasks.workunit.client.0.trial092.stdout: "tiers": [], 2026-02-17T00:52:01.832 INFO:tasks.workunit.client.0.trial092.stdout: "tier_of": -1, 2026-02-17T00:52:01.832 INFO:tasks.workunit.client.0.trial092.stdout: "read_tier": -1, 2026-02-17T00:52:01.832 INFO:tasks.workunit.client.0.trial092.stdout: "write_tier": -1, 2026-02-17T00:52:01.832 INFO:tasks.workunit.client.0.trial092.stdout: "cache_mode": "none", 2026-02-17T00:52:01.832 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_bytes": 0, 2026-02-17T00:52:01.832 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_objects": 0, 2026-02-17T00:52:01.832 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T00:52:01.832 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T00:52:01.832 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T00:52:01.832 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_flush_age": 0, 2026-02-17T00:52:01.833 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_evict_age": 0, 2026-02-17T00:52:01.833 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profile": "", 2026-02-17T00:52:01.833 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_params": { 2026-02-17T00:52:01.833 INFO:tasks.workunit.client.0.trial092.stdout: "type": "none" 2026-02-17T00:52:01.833 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.833 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_period": 0, 2026-02-17T00:52:01.833 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_count": 0, 2026-02-17T00:52:01.833 INFO:tasks.workunit.client.0.trial092.stdout: "use_gmt_hitset": true, 2026-02-17T00:52:01.833 INFO:tasks.workunit.client.0.trial092.stdout: "min_read_recency_for_promote": 0, 2026-02-17T00:52:01.833 INFO:tasks.workunit.client.0.trial092.stdout: "min_write_recency_for_promote": 0, 2026-02-17T00:52:01.833 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_search_last_n": 0, 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "grade_table": [], 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "stripe_width": 0, 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "expected_num_objects": 0, 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "fast_read": false, 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "nonprimary_shards": "{}", 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "options": {}, 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "application_metadata": {}, 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "read_balance": { 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "score_type": "Fair distribution", 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "score_acting": 2.9900000095367432, 2026-02-17T00:52:01.834 INFO:tasks.workunit.client.0.trial092.stdout: "score_stable": 2.9900000095367432, 2026-02-17T00:52:01.835 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T00:52:01.835 INFO:tasks.workunit.client.0.trial092.stdout: "raw_score_acting": 2, 2026-02-17T00:52:01.835 INFO:tasks.workunit.client.0.trial092.stdout: "raw_score_stable": 2, 2026-02-17T00:52:01.835 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity_weighted": 1, 2026-02-17T00:52:01.835 INFO:tasks.workunit.client.0.trial092.stdout: "average_primary_affinity": 1, 2026-02-17T00:52:01.835 INFO:tasks.workunit.client.0.trial092.stdout: "average_primary_affinity_weighted": 1 2026-02-17T00:52:01.835 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.835 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.835 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.835 INFO:tasks.workunit.client.0.trial092.stdout: "osds": [ 2026-02-17T00:52:01.835 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.836 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:52:01.836 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "977772d6-e907-41e1-b1c9-ce449dd30a26", 2026-02-17T00:52:01.836 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:52:01.836 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:52:01.836 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:52:01.836 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:52:01.836 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 5, 2026-02-17T00:52:01.836 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 28, 2026-02-17T00:52:01.836 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 35, 2026-02-17T00:52:01.836 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 39, 2026-02-17T00:52:01.836 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 29, 2026-02-17T00:52:01.837 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:52:01.837 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:52:01.837 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.837 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.837 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.837 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6800", 2026-02-17T00:52:01.837 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:01.837 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.837 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.838 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.838 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6801", 2026-02-17T00:52:01.838 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:01.838 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.838 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.838 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.838 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:52:01.838 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.838 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.838 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.838 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6802", 2026-02-17T00:52:01.839 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:01.839 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.839 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.839 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.839 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6803", 2026-02-17T00:52:01.839 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:01.839 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.839 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.839 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.839 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:52:01.839 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.840 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.840 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.840 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6806", 2026-02-17T00:52:01.840 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:01.840 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.840 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.840 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.840 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6807", 2026-02-17T00:52:01.840 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:01.840 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.840 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.841 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.841 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:52:01.841 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.841 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.841 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.841 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6804", 2026-02-17T00:52:01.841 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:01.841 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.841 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.841 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.841 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6805", 2026-02-17T00:52:01.842 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:01.842 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.842 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.842 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.842 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6801/2478527939", 2026-02-17T00:52:01.842 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6803/2478527939", 2026-02-17T00:52:01.842 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2478527939", 2026-02-17T00:52:01.842 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2478527939", 2026-02-17T00:52:01.842 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:52:01.842 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:52:01.842 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:52:01.843 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.843 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.843 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.843 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:52:01.843 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "e3a77d41-a7b1-4813-9488-a1b9bb60be11", 2026-02-17T00:52:01.843 INFO:tasks.workunit.client.0.trial092.stdout: "up": 0, 2026-02-17T00:52:01.843 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:52:01.843 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:52:01.843 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:52:01.843 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 0, 2026-02-17T00:52:01.843 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 0, 2026-02-17T00:52:01.844 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 10, 2026-02-17T00:52:01.844 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 22, 2026-02-17T00:52:01.844 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 30, 2026-02-17T00:52:01.844 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:52:01.844 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:52:01.844 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.844 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.844 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.844 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:52:01.844 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:01.844 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.845 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.845 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.845 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:52:01.845 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:01.845 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.845 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.845 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.845 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:52:01.845 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.845 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.845 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:52:01.846 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.847 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.847 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.847 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:52:01.847 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:01.847 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.847 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.847 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.847 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:52:01.847 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:01.847 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.847 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.848 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.848 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:52:01.848 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.848 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.848 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.848 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:52:01.848 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:01.848 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.848 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.848 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.849 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:52:01.849 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:01.849 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.849 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.849 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.849 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/3245503761", 2026-02-17T00:52:01.849 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/3245503761", 2026-02-17T00:52:01.849 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3245503761", 2026-02-17T00:52:01.849 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3245503761", 2026-02-17T00:52:01.849 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:52:01.849 INFO:tasks.workunit.client.0.trial092.stdout: "exists" 2026-02-17T00:52:01.850 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.850 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.850 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.850 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:52:01.850 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "10379749-15c0-4a15-8266-d3fffe22e6fe", 2026-02-17T00:52:01.850 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:52:01.850 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:52:01.850 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:52:01.850 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:52:01.850 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 14, 2026-02-17T00:52:01.850 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 28, 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 37, 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 0, 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 31, 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.851 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:01.852 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.853 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:52:01.854 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/314318210", 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/314318210", 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/314318210", 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/314318210", 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:52:01.855 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: "osd_xinfo": [ 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:51:25.979980+0000", 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:52:01.856 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:50:54.591011+0000", 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:51:26.268214+0000", 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:51:26.573108+0000", 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:52:01.857 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:50:59.195789+0000", 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap": [], 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_items": [], 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_primaries": [], 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "pg_temp": [], 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "primary_temp": [], 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "blocklist": {}, 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "range_blocklist": {}, 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profiles": { 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "default": { 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "k": "2", 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "m": "2", 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "plugin": "isa", 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "technique": "reed_sol_van" 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.858 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps_queue": [], 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "new_removed_snaps": [], 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "new_purged_snaps": [], 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "crush_node_flags": {}, 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "device_class_flags": {}, 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": { 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_enabled": false, 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_bucket_count": 0, 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "degraded_stretch_mode": 0, 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "recovering_stretch_mode": 0, 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_bucket": 0 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "osd_metadata": [ 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6802/2478527939,v1:127.0.0.1:6803/2478527939]", 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:52:01.859 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:50:52.895256Z", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:52:01.860 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6800/2478527939,v1:127.0.0.1:6801/2478527939]", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2478527939,v1:127.0.0.1:6807/2478527939]", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2478527939,v1:127.0.0.1:6805/2478527939]", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:52:01.861 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/3245503761,v1:127.0.0.1:6813/3245503761]", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:52:01.862 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:50:54.806752Z", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/3245503761,v1:127.0.0.1:6811/3245503761]", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3245503761,v1:127.0.0.1:6817/3245503761]", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3245503761,v1:127.0.0.1:6815/3245503761]", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:52:01.863 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/314318210,v1:127.0.0.1:6813/314318210]", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:52:01.864 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:50:57.394690Z", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:52:01.865 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/314318210,v1:127.0.0.1:6811/314318210]", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/314318210,v1:127.0.0.1:6817/314318210]", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/314318210,v1:127.0.0.1:6815/314318210]", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_clean_epochs": { 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "min_last_epoch_clean": 0, 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": { 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: "per_pool": [] 2026-02-17T00:52:01.866 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "osd_epochs": [ 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 35 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 37 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_first_committed": 1, 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_last_committed": 40, 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "crushmap": { 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "devices": [ 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.0", 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.1", 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.867 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.2", 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "types": [ 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 0, 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd" 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "name": "host" 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 2, 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "name": "chassis" 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 3, 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "name": "rack" 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 4, 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: "name": "row" 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.868 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 5, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pdu" 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 6, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pod" 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 7, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "name": "room" 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 8, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "name": "datacenter" 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 9, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "name": "zone" 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 10, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "name": "region" 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:52:01.869 INFO:tasks.workunit.client.0.trial092.stdout: "name": "root" 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "buckets": [ 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "id": -1, 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default", 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "id": -2, 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default~ssd", 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:52:01.870 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092", 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.871 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092~ssd", 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:01.872 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "rules": [ 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "rule_id": 0, 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "rule_name": "replicated_rule", 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "steps": [ 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "op": "take", 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "item": -1, 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "item_name": "default" 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "op": "choose_firstn", 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "num": 0, 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "type": "osd" 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "op": "emit" 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "tunables": { 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_tries": 0, 2026-02-17T00:52:01.873 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_fallback_tries": 0, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "choose_total_tries": 50, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_descend_once": 1, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_vary_r": 1, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_stable": 1, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "msr_descents": 100, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "msr_collision_tries": 100, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "straw_calc_version": 1, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "allowed_bucket_algs": 54, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "profile": "jewel", 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_tunables": 1, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "legacy_tunables": 0, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "minimum_required_version": "jewel", 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables": 1, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables2": 1, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "has_v2_rules": 0, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables3": 1, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "has_v3_rules": 0, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "has_v4_buckets": 1, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables5": 1, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stdout: "has_v5_rules": 0, 2026-02-17T00:52:01.874 INFO:tasks.workunit.client.0.trial092.stderr:report 1216229687 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "has_msr_rules": 0 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "choose_args": {} 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "fsmap": { 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "btime": "2026-02-17T00:50:52:206358+0000", 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "default_fscid": -1, 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "compat": { 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "compat": {}, 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "ro_compat": {}, 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "incompat": { 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "feature_1": "base v0.20", 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "feature_2": "client writeable ranges", 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "feature_4": "dir inode in separate object", 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "feature_8": "no anchor table", 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "feature_9": "file layout v2", 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "feature_10": "snaprealm v2", 2026-02-17T00:52:01.875 INFO:tasks.workunit.client.0.trial092.stdout: "feature_11": "minor log segments", 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "feature_flags": { 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "enable_multiple": true, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "ever_enabled_multiple": true 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "standbys": [], 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "filesystems": [] 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_first_committed": 1, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_last_committed": 1, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "auth": { 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 5, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_secrets": 3 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 1, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_active": 1, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_unknown": 0, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_osd": 3, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "pool_sum": { 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 51200, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 100, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 0, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 300, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:52:01.876 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 100, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 100, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 100, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 100, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:52:01.877 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 16, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 16, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "up": 2, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 2, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 0 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum": { 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 3, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83864, 2026-02-17T00:52:01.878 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2080, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 23, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81704, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488936, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036670464, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2129920, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 422347, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 24097, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83665375 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:52:01.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum_by_class": { 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "ssd": { 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 3, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83864, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2080, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 23, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81704, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488936, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036670464, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2129920, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 422347, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 24097, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83665375 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:52:01.880 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "pool_stats": [ 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": 1, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 1, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 51200, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 100, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 0, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 300, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 100, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 100, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:52:01.881 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 100, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 100, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:52:01.882 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 1220608, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 153552, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 16, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 16, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "up": 2, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 2, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 3 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "osd_stats": [ 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 150323855369 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 42949672972 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 158913789961 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.883 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_state": [ 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "state": "active+undersized+degraded", 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num": 1 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "pool_pg_unavailable_map": [ 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": "1", 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "pgs": [] 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_osd": [ 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 1, 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 0, 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.884 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": [ 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": {} 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "servicemap": { 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 3, 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:51:58.441005+0000", 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "services": { 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "osd": { 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "daemons": { 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "summary": "", 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "0": { 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "start_epoch": 0, 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "start_stamp": "0.000000", 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "gid": 0, 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "metadata": {}, 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "task_status": {} 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "2": { 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "start_epoch": 0, 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "start_stamp": "0.000000", 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "gid": 0, 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "metadata": {}, 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: "task_status": {} 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.885 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_first_committed": 1, 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_last_committed": 35, 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stdout: "logm_first_committed": 1, 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stdout: "logm_last_committed": 211, 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stdout: "paxos": { 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 297, 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stdout: "last_pn": 0, 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stdout: "accepted_pn": 0 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: expr 2 + 2 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: objname=existing_4 2026-02-17T00:52:01.886 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2026-02-17T00:52:01.887 INFO:tasks.workunit.client.0.trial092.stdout:writing non-divergent object existing_4 2026-02-17T00:52:01.887 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:52:02.044 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:52:02.044 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:51:31.428852+0000 28'100 40:128 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:50:15.494952+0000 0 0 2026-02-17T00:52:02.044 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:52:02.044 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:52:02.044 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:52:02.051 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:532: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.MJUanVFfyu 2026-02-17T00:52:02.072 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: rm -f /tmp/tmp.MJUanVFfyu 2026-02-17T00:52:02.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T00:52:02.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: wait_for_clean 2026-02-17T00:52:02.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:52:02.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:52:02.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:52:02.073 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T00:52:02.073 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:52:02.074 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:52:02.074 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:52:02.074 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:52:02.074 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:52:02.126 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T00:52:02.126 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:52:02.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:52:02.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:52:02.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:52:02.127 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:52:02.360 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:52:02.360 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:52:02.360 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:52:02.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:52:02.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:52:02.361 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:52:02.430 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-17T00:52:02.430 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-17T00:52:02.430 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371' 2026-02-17T00:52:02.430 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:52:02.431 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:52:02.478 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T00:52:02.479 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T00:52:02.479 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T00:52:02.479 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T00:52:02.479 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:52:02.479 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:52:02.547 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789963 2026-02-17T00:52:02.547 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789963 2026-02-17T00:52:02.547 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371 2-158913789963' 2026-02-17T00:52:02.547 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:52:02.547 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855371 2026-02-17T00:52:02.547 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:52:02.548 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:52:02.548 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855371 2026-02-17T00:52:02.549 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:52:02.549 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855371 2026-02-17T00:52:02.549 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855371' 2026-02-17T00:52:02.550 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 150323855371 2026-02-17T00:52:02.550 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:52:02.779 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855371 -lt 150323855371 2026-02-17T00:52:02.779 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:52:02.780 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789963 2026-02-17T00:52:02.780 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:52:02.781 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:52:02.781 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789963 2026-02-17T00:52:02.781 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:52:02.782 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789963 2026-02-17T00:52:02.782 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789963' 2026-02-17T00:52:02.783 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 158913789963 2026-02-17T00:52:02.783 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:52:03.011 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789961 -lt 158913789963 2026-02-17T00:52:03.011 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:52:04.011 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:52:04.012 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:52:04.244 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789961 -lt 158913789963 2026-02-17T00:52:04.244 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:52:05.245 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T00:52:05.245 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:52:05.474 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789963 -lt 158913789963 2026-02-17T00:52:05.474 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:52:05.474 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:52:05.474 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:52:05.787 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:52:05.787 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:52:05.787 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:52:05.787 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:52:05.787 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:52:05.787 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:52:05.787 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:52:05.787 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:52:06.013 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:52:06.014 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:52:06.014 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:52:06.014 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:52:06.337 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:52:06.337 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T00:52:06.338 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T00:52:06.338 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T00:52:06.338 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:52:06.338 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T00:52:06.437 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:52:06.437 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:52:06.437 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:52:06.438 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:52:06.438 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:52:06.438 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:52:06.438 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:52:06.438 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:52:06.667 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:52:06.667 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:52:06.668 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:52:06.668 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:52:06.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:52:06.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:52:06.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:52:06.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:52:06.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:52:06.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:52:06.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:52:06.988 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:52:06.988 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:52:07.309 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:52:07.309 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:52:07.309 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T00:52:07.309 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:52:07.309 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T00:52:07.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:52:07.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:52:07.510 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:52:07.510 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:52:07.510 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:52:07.510 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:52:07.510 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:52:07.510 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:52:07.737 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:52:07.737 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:52:07.737 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:52:07.737 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:52:08.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:52:08.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:52:08.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:52:08.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:52:08.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:52:08.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:52:08.055 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:52:08.055 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:52:08.055 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:52:08.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:52:08.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:52:08.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T00:52:08.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:52:08.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T00:52:08.774 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:52:08.774 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:52:08.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:52:08.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:52:08.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:52:08.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:52:08.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:52:08.775 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:52:09.002 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:52:09.002 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:52:09.002 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:52:09.002 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:52:09.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:52:09.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:52:09.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:52:09.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:52:09.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:52:09.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:52:09.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:52:09.322 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:52:09.322 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:52:09.659 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:52:09.659 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:52:09.659 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T00:52:09.659 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:52:09.659 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T00:52:10.459 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:52:10.459 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:52:10.460 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:52:10.460 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:52:10.460 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:52:10.460 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:52:10.461 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:52:10.461 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:52:10.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:52:10.689 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:52:10.689 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:52:10.689 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:52:11.012 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:52:11.012 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:52:11.012 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:52:11.012 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:52:11.012 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:52:11.012 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:52:11.012 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:52:11.012 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:52:11.013 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:52:11.350 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:52:11.350 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:52:11.350 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T00:52:11.350 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:52:11.350 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T00:52:12.952 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:52:12.952 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:52:12.952 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:52:12.952 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:52:12.952 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:52:12.952 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:52:12.952 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:52:12.953 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:52:13.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:52:13.181 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:52:13.182 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:52:13.182 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:52:13.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:52:13.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:52:13.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:52:13.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:52:13.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:52:13.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:52:13.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:52:13.511 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:52:13.511 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:52:13.846 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:52:13.846 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:52:13.846 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T00:52:13.846 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:52:13.846 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T00:52:17.047 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:52:17.047 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:52:17.048 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:52:17.048 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:52:17.048 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:52:17.048 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:52:17.048 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:52:17.048 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:52:17.279 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:52:17.280 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:52:17.280 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:52:17.280 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:52:17.602 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:52:17.602 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:52:17.603 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:52:17.603 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:52:17.603 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:52:17.603 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:52:17.603 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:52:17.603 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:52:17.603 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:52:17.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:52:17.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:52:17.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T00:52:17.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:52:17.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T00:52:24.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:52:24.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:52:24.322 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:52:24.322 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:52:24.322 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:52:24.322 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:52:24.322 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:52:24.323 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:52:24.552 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:52:24.553 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:52:24.553 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:52:24.553 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:52:24.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:52:24.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:52:24.879 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:52:24.879 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:52:24.879 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:52:24.879 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:52:24.879 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:52:24.879 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:52:24.879 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:52:25.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:52:25.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:52:25.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T00:52:25.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:52:25.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T00:52:32.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:52:32.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:52:32.501 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:52:32.501 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:52:32.501 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:52:32.501 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:52:32.501 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:52:32.501 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:52:32.731 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:52:32.732 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:52:32.732 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:52:32.732 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:52:33.053 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:52:33.053 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:52:33.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:52:33.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:52:33.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:52:33.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:52:33.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:52:33.054 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:52:33.054 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:52:33.373 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:52:33.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:52:33.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T00:52:33.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_fingerprint": "a7405210-f3ca-42ed-9c5d-3d93b8b7e99d", 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "version": "20.3.0-5225-g03ef619e", 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "commit": "03ef619e79a56cd363b087a5c6f19a1a09b49040", 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "timestamp": "2026-02-17T00:52:33.680978+0000", 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "tag": "", 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "health": { 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "status": "HEALTH_WARN", 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "checks": { 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "OSDMAP_FLAGS": { 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "count": 17 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.685 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [], 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "OSD_DOWN": { 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "message": "1 osds down", 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "count": 1 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "message": "osd.1 (root=default,host=trial092) is down" 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "PG_DEGRADED": { 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded, 1 pg undersized", 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "count": 2 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.0 is stuck undersized for 61s, current state active+undersized+degraded, last acting [0,2]" 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "mutes": [] 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_first_committed": 1, 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_last_committed": 1, 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "monmap": { 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:50:52.172246Z", 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:50:52.172246Z", 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release": 20, 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release_name": "tentacle", 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "election_strategy": 1, 2026-02-17T00:52:33.686 INFO:tasks.workunit.client.0.trial092.stdout: "disallowed_leaders": "", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": false, 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "tiebreaker_mon": "", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "removed_ranks": "", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "features": { 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "persistent": [ 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "kraken", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "luminous", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "mimic", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap-prune", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "nautilus", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "octopus", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "pacific", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "elector-pinging", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "quincy", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "reef", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "squid", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "tentacle", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "nvmeof_beacon_diff" 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "optional": [] 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "mons": [ 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "rank": 0, 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "name": "a", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 0 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "priority": 0, 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 0, 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "time_added": "2026-02-17T00:50:52:172242+0000", 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "crush_location": [] 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: "quorum": [ 2026-02-17T00:52:33.687 INFO:tasks.workunit.client.0.trial092.stdout: 0 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap": { 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 40, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:50:52.206521+0000", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:51:31.426619+0000", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "last_up_change": "2026-02-17T00:51:29.803880+0000", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "last_in_change": "2026-02-17T00:51:31.324676+0000", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "flags_num": 5800384, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "flags_set": [ 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "nodown", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "noin", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "noout", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "pglog_hardlimit", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snapdirs", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "recovery_deletes", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "sortbitwise" 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "crush_version": 9, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_snapshot": "", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "pool_max": 1, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "max_osd": 3, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "require_min_compat_client": "luminous", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "min_compat_client": "jewel", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "require_osd_release": "tentacle", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "allow_crimson": false, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "pools": [ 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "pool_name": "test", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "create_time": "2026-02-17T00:51:00.531303+0000", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "flags": 1, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "flags_names": "hashpspool", 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "size": 3, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "min_size": 2, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "crush_rule": 0, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_count": 0, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_target": 0, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T00:52:33.688 INFO:tasks.workunit.client.0.trial092.stdout: "is_stretch_pool": false, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "object_hash": 2, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "pg_autoscale_mode": "off", 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num": 1, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num": 1, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num_target": 1, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_target": 1, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_pending": 1, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "last_pg_merge_meta": { 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "source_pgid": "0.0", 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "ready_epoch": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_started": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "source_version": "0'0", 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "target_version": "0'0" 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "last_change": "28", 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend": "0", 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "auid": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "snap_mode": "selfmanaged", 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "snap_seq": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "snap_epoch": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "pool_snaps": [], 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps": "[]", 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_bytes": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_objects": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "tiers": [], 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "tier_of": -1, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "read_tier": -1, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "write_tier": -1, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "cache_mode": "none", 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_bytes": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_objects": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_flush_age": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_evict_age": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profile": "", 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_params": { 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "type": "none" 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_period": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_count": 0, 2026-02-17T00:52:33.689 INFO:tasks.workunit.client.0.trial092.stdout: "use_gmt_hitset": true, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "min_read_recency_for_promote": 0, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "min_write_recency_for_promote": 0, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_search_last_n": 0, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "grade_table": [], 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "stripe_width": 0, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "expected_num_objects": 0, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "fast_read": false, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "nonprimary_shards": "{}", 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "options": {}, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "application_metadata": {}, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "read_balance": { 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "score_type": "Fair distribution", 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "score_acting": 2.9900000095367432, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "score_stable": 2.9900000095367432, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "raw_score_acting": 2, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "raw_score_stable": 2, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity_weighted": 1, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "average_primary_affinity": 1, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "average_primary_affinity_weighted": 1 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "osds": [ 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "977772d6-e907-41e1-b1c9-ce449dd30a26", 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 5, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 28, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 35, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 39, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 29, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6800", 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.690 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6801", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6802", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6803", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6806", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6807", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6804", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6805", 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2478527939 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.691 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6801/2478527939", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6803/2478527939", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2478527939", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2478527939", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "e3a77d41-a7b1-4813-9488-a1b9bb60be11", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "up": 0, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 0, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 0, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 10, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 22, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 30, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:52:33.692 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3245503761 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/3245503761", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/3245503761", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3245503761", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3245503761", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "exists" 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "10379749-15c0-4a15-8266-d3fffe22e6fe", 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:52:33.693 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 14, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 28, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 37, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 0, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 31, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.694 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 314318210 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/314318210", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/314318210", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/314318210", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/314318210", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "osd_xinfo": [ 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:51:25.979980+0000", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:50:54.591011+0000", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:51:26.268214+0000", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.695 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:51:26.573108+0000", 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:50:59.195789+0000", 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap": [], 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_items": [], 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_primaries": [], 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "pg_temp": [], 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "primary_temp": [], 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "blocklist": {}, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "range_blocklist": {}, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profiles": { 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "default": { 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "k": "2", 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "m": "2", 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "plugin": "isa", 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "technique": "reed_sol_van" 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps_queue": [], 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "new_removed_snaps": [], 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "new_purged_snaps": [], 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "crush_node_flags": {}, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "device_class_flags": {}, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": { 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_enabled": false, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_bucket_count": 0, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "degraded_stretch_mode": 0, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "recovering_stretch_mode": 0, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_bucket": 0 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "osd_metadata": [ 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6802/2478527939,v1:127.0.0.1:6803/2478527939]", 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:52:33.696 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:50:52.895256Z", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6800/2478527939,v1:127.0.0.1:6801/2478527939]", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2478527939,v1:127.0.0.1:6807/2478527939]", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2478527939,v1:127.0.0.1:6805/2478527939]", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.697 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/3245503761,v1:127.0.0.1:6813/3245503761]", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:50:54.806752Z", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/3245503761,v1:127.0.0.1:6811/3245503761]", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3245503761,v1:127.0.0.1:6817/3245503761]", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3245503761,v1:127.0.0.1:6815/3245503761]", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:52:33.698 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/314318210,v1:127.0.0.1:6813/314318210]", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:50:57.394690Z", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/314318210,v1:127.0.0.1:6811/314318210]", 2026-02-17T00:52:33.699 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/314318210,v1:127.0.0.1:6817/314318210]", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/314318210,v1:127.0.0.1:6815/314318210]", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_clean_epochs": { 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "min_last_epoch_clean": 0, 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": { 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "per_pool": [] 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "osd_epochs": [ 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 35 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 37 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_first_committed": 1, 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_last_committed": 40, 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "crushmap": { 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "devices": [ 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.0", 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:52:33.700 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.1", 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.2", 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "types": [ 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 0, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd" 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "name": "host" 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 2, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "name": "chassis" 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 3, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "name": "rack" 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 4, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "name": "row" 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 5, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pdu" 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 6, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pod" 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 7, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "name": "room" 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 8, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "name": "datacenter" 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.701 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 9, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "name": "zone" 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 10, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "name": "region" 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "name": "root" 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "buckets": [ 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "id": -1, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default", 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "id": -2, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default~ssd", 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:52:33.702 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092", 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092~ssd", 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.703 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "rules": [ 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "rule_id": 0, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "rule_name": "replicated_rule", 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "steps": [ 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "op": "take", 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "item": -1, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "item_name": "default" 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "op": "choose_firstn", 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "num": 0, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "type": "osd" 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "op": "emit" 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "tunables": { 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_tries": 0, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_fallback_tries": 0, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "choose_total_tries": 50, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_descend_once": 1, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_vary_r": 1, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_stable": 1, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "msr_descents": 100, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "msr_collision_tries": 100, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "straw_calc_version": 1, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "allowed_bucket_algs": 54, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "profile": "jewel", 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_tunables": 1, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "legacy_tunables": 0, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "minimum_required_version": "jewel", 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables": 1, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables2": 1, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "has_v2_rules": 0, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables3": 1, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "has_v3_rules": 0, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "has_v4_buckets": 1, 2026-02-17T00:52:33.704 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables5": 1, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "has_v5_rules": 0, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "has_msr_rules": 0 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "choose_args": {} 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "fsmap": { 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "btime": "2026-02-17T00:50:52:206358+0000", 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "default_fscid": -1, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "compat": { 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "compat": {}, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "ro_compat": {}, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "incompat": { 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_1": "base v0.20", 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_2": "client writeable ranges", 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_4": "dir inode in separate object", 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_8": "no anchor table", 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_9": "file layout v2", 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_10": "snaprealm v2", 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_11": "minor log segments", 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "feature_flags": { 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "enable_multiple": true, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "ever_enabled_multiple": true 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "standbys": [], 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "filesystems": [] 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_first_committed": 1, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_last_committed": 1, 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "auth": { 2026-02-17T00:52:33.705 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 5, 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "num_secrets": 3 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 1, 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_active": 1, 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_unknown": 0, 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "num_osd": 3, 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "pool_sum": { 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 51688, 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 100, 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 0, 2026-02-17T00:52:33.706 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 300, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 100, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 100, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 101, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 101, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:52:33.707 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:52:33.708 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 0, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 0, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 17, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 17, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "up": 2, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 2, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 0 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum": { 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 3, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83864, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2080, 2026-02-17T00:52:33.709 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 23, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81704, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488936, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036670464, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2129920, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 423323, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 24097, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83665375 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:52:33.710 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum_by_class": { 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "ssd": { 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 3, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83864, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2080, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 23, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81704, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488936, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036670464, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2129920, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 423323, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 24097, 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83665375 2026-02-17T00:52:33.711 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "pool_stats": [ 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": 1, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 1, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 51688, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 100, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 0, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 300, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 100, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:52:33.712 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 100, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 101, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 101, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:52:33.713 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 1220608, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 154528, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 17, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 17, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "up": 2, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 2, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 3 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "osd_stats": [ 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 150323855377 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 42949672972 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.714 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 158913789969 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_state": [ 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "state": "active+undersized+degraded", 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "num": 1 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "pool_pg_unavailable_map": [ 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": "1", 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "pgs": [] 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_osd": [ 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 1, 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:52:33.715 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 0, 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": [ 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": {} 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "servicemap": { 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 5, 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:52:30.444548+0000", 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "services": {} 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_first_committed": 1, 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_last_committed": 51, 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "logm_first_committed": 1, 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "logm_last_committed": 276, 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "paxos": { 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 378, 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "last_pn": 0, 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: "accepted_pn": 0 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:52:33.716 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:52:33.717 INFO:tasks.workunit.client.0.trial092.stderr:report 2445818812 2026-02-17T00:52:33.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T00:52:33.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: echo 'delay recovery' 2026-02-17T00:52:33.717 INFO:tasks.workunit.client.0.trial092.stdout:delay recovery 2026-02-17T00:52:33.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:539: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:52:33.913 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:52:33.913 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:51:31.428852+0000 40'101 40:129 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:50:15.494952+0000 0 0 2026-02-17T00:52:33.913 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:52:33.913 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:52:33.913 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:52:33.919 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-17T00:52:33.920 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.0 2026-02-17T00:52:33.920 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T00:52:33.920 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T00:52:33.920 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:52:33.920 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:52:33.920 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:52:33.921 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.0.asok 2026-02-17T00:52:33.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-17T00:52:33.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T00:52:33.966 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:52:33.970 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-17T00:52:33.970 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.2 2026-02-17T00:52:33.970 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T00:52:33.970 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T00:52:33.971 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:52:33.971 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:52:33.971 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:52:33.971 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.2.asok 2026-02-17T00:52:33.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-17T00:52:33.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T00:52:34.017 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:52:34.021 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: echo 'revive divergent 1' 2026-02-17T00:52:34.022 INFO:tasks.workunit.client.0.trial092.stdout:revive divergent 1 2026-02-17T00:52:34.022 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:52:34.257 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:52:34.257 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:51:31.428852+0000 40'101 40:129 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:50:15.494952+0000 0 0 2026-02-17T00:52:34.257 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:52:34.257 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:52:34.257 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:52:34.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: ceph osd set noup 2026-02-17T00:52:34.600 INFO:tasks.workunit.client.0.trial092.stderr:noup is set 2026-02-17T00:52:34.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:549: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-17T00:52:34.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:52:34.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:52:34.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T00:52:34.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:52:34.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:52:34.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:52:34.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:52:34.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:52:34.614 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T00:52:34.614 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T00:52:34.615 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:52:34.615 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:52:34.615 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:52:34.632 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:52:34.627+0000 7fa4f7857780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:52:34.634 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:52:34.628+0000 7fa4f7857780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:52:34.635 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:52:34.629+0000 7fa4f7857780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:52:34.776 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:52:34.770+0000 7fa4f7857780 -1 Falling back to public interface 2026-02-17T00:52:34.845 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T00:52:34.845 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: sleep 5 2026-02-17T00:52:35.051 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:52:35.045+0000 7fa4f7857780 -1 osd.1 28 log_to_monitors true 2026-02-17T00:52:39.846 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: echo 'delay recovery divergent' 2026-02-17T00:52:39.846 INFO:tasks.workunit.client.0.trial092.stdout:delay recovery divergent 2026-02-17T00:52:39.847 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:553: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:52:40.070 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:52:40.070 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:51:31.428852+0000 40'101 43:135 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:50:15.494952+0000 0 0 2026-02-17T00:52:40.070 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:52:40.070 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:52:40.070 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:52:40.078 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: get_asok_path osd.1 2026-02-17T00:52:40.078 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T00:52:40.078 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T00:52:40.078 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:52:40.079 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:52:40.079 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:52:40.079 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.1.asok 2026-02-17T00:52:40.079 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: CEPH_ARGS= 2026-02-17T00:52:40.079 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T00:52:40.124 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:52:40.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: ceph osd unset noup 2026-02-17T00:52:40.442 INFO:tasks.workunit.client.0.trial092.stderr:noup is unset 2026-02-17T00:52:40.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 0 2026-02-17T00:52:40.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:52:40.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:52:40.453 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:52:40.453 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:52:40.453 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:52:40.453 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:52:40.454 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:52:40.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:52:40.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:52:40.687 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 35 up_thru 39 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/2478527939,v1:127.0.0.1:6801/2478527939] [v2:127.0.0.1:6802/2478527939,v1:127.0.0.1:6803/2478527939] exists,up 977772d6-e907-41e1-b1c9-ce449dd30a26 2026-02-17T00:52:40.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:52:40.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:52:40.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:52:40.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:559: TEST_divergent_2: wait_for_osd up 1 2026-02-17T00:52:40.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:52:40.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:52:40.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:52:40.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:52:40.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:52:40.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:52:40.688 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:52:40.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:52:40.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:52:40.926 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/3543416212,v1:127.0.0.1:6819/3543416212] [v2:127.0.0.1:6820/3543416212,v1:127.0.0.1:6821/3543416212] exists,up e3a77d41-a7b1-4813-9488-a1b9bb60be11 2026-02-17T00:52:40.928 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:52:40.928 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:52:40.928 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:52:40.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: wait_for_osd up 2 2026-02-17T00:52:40.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:52:40.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:52:40.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:52:40.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:52:40.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:52:40.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:52:40.930 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:52:40.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:52:40.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:52:41.158 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 37 up_thru 0 down_at 31 last_clean_interval [14,28) [v2:127.0.0.1:6810/314318210,v1:127.0.0.1:6811/314318210] [v2:127.0.0.1:6812/314318210,v1:127.0.0.1:6813/314318210] exists,up 10379749-15c0-4a15-8266-d3fffe22e6fe 2026-02-17T00:52:41.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:52:41.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:52:41.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:52:41.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:52:41.383 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:52:41.384 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:51:31.428852+0000 40'101 43:135 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:50:15.494952+0000 0 0 2026-02-17T00:52:41.384 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:52:41.384 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:52:41.384 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:52:41.391 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: echo 'wait for peering' 2026-02-17T00:52:41.391 INFO:tasks.workunit.client.0.trial092.stdout:wait for peering 2026-02-17T00:52:41.392 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:564: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:52:41.611 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:52:41.611 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:51:31.428852+0000 40'101 43:135 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:50:15.494952+0000 0 0 2026-02-17T00:52:41.611 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:52:41.611 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:52:41.612 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:52:41.618 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:565: TEST_divergent_2: rados -p test put foo /tmp/tmp.Ud8hAexMjj 2026-02-17T00:52:41.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:566: TEST_divergent_2: rm -f /tmp/tmp.Ud8hAexMjj 2026-02-17T00:52:41.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:570: TEST_divergent_2: echo 'killing divergent 1' 2026-02-17T00:52:41.639 INFO:tasks.workunit.client.0.trial092.stdout:killing divergent 1 2026-02-17T00:52:41.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:571: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:52:41.860 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:52:41.860 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:51:31.428852+0000 40'101 43:135 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:50:15.494952+0000 0 0 2026-02-17T00:52:41.860 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:52:41.860 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:52:41.860 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:52:41.867 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T00:52:41.867 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:52:41.867 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:52:41.867 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:52:41.867 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:52:41.867 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:52:41.975 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:52:41.975 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:575: TEST_divergent_2: expfile=td/divergent-priors/exp.44472.out 2026-02-17T00:52:41.975 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.44472.out 2026-02-17T00:52:41.975 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T00:52:41.975 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T00:52:41.975 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T00:52:41.975 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T00:52:41.975 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T00:52:41.975 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.44472.out 2026-02-17T00:52:42.062 INFO:tasks.workunit.client.0.trial092.stderr:Exporting 1.0 info 1.0( v 47'102 lc 0'0 (28'90,47'102] local-lis/les=45/46 n=101 ec=22/22 lis/c=45/22 les/c/f=46/23/0 sis=45) 2026-02-17T00:52:42.062 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-17T00:52:42.062 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-17T00:52:42.063 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-17T00:52:42.063 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:091f9f1d:::existing_94:head# 2026-02-17T00:52:42.063 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:0a865a93:::existing_54:head# 2026-02-17T00:52:42.063 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:0fed513c:::existing_41:head# 2026-02-17T00:52:42.063 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:13b9e0b8:::existing_92:head# 2026-02-17T00:52:42.064 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:169157fa:::existing_81:head# 2026-02-17T00:52:42.064 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:17731382:::existing_58:head# 2026-02-17T00:52:42.064 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:18a45a39:::existing_43:head# 2026-02-17T00:52:42.064 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:1c160f01:::existing_66:head# 2026-02-17T00:52:42.064 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:1dd6c249:::existing_97:head# 2026-02-17T00:52:42.064 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:227e0c77:::existing_7:head# 2026-02-17T00:52:42.064 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:23e1b063:::existing_59:head# 2026-02-17T00:52:42.064 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:28566edb:::existing_78:head# 2026-02-17T00:52:42.065 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:2a101182:::existing_20:head# 2026-02-17T00:52:42.065 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:2d1519da:::existing_96:head# 2026-02-17T00:52:42.065 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:3078b87a:::existing_86:head# 2026-02-17T00:52:42.065 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:30bde01b:::existing_15:head# 2026-02-17T00:52:42.065 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:317a7e19:::existing_56:head# 2026-02-17T00:52:42.065 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:38b9c7fa:::existing_33:head# 2026-02-17T00:52:42.065 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:3e16d84b:::existing_48:head# 2026-02-17T00:52:42.065 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:45fe8203:::existing_75:head# 2026-02-17T00:52:42.065 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:4e82c9ba:::existing_50:head# 2026-02-17T00:52:42.066 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:5298dcdb:::existing_57:head# 2026-02-17T00:52:42.066 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:52ebaa44:::existing_32:head# 2026-02-17T00:52:42.066 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:53588912:::existing_9:head# 2026-02-17T00:52:42.066 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:5b7e2de6:::existing_84:head# 2026-02-17T00:52:42.066 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:5da0255c:::existing_13:head# 2026-02-17T00:52:42.066 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:5da2dab8:::existing_53:head# 2026-02-17T00:52:42.066 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:5ee3514b:::existing_30:head# 2026-02-17T00:52:42.066 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:602f83fe:::foo:head# 2026-02-17T00:52:42.067 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:60426cc7:::existing_62:head# 2026-02-17T00:52:42.067 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:628918ca:::existing_79:head# 2026-02-17T00:52:42.067 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:63f8ab2d:::existing_77:head# 2026-02-17T00:52:42.067 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:67e1780f:::existing_27:head# 2026-02-17T00:52:42.067 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:68143ca1:::existing_71:head# 2026-02-17T00:52:42.068 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:6bac9509:::existing_29:head# 2026-02-17T00:52:42.068 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:6bbec798:::existing_45:head# 2026-02-17T00:52:42.068 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:6cb23a40:::existing_65:head# 2026-02-17T00:52:42.068 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:7055ec5e:::existing_83:head# 2026-02-17T00:52:42.068 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:70a54e2b:::existing_87:head# 2026-02-17T00:52:42.068 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:750ace21:::existing_19:head# 2026-02-17T00:52:42.068 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:78623b1d:::existing_6:head# 2026-02-17T00:52:42.068 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:79881152:::existing_63:head# 2026-02-17T00:52:42.068 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:7a80c0d5:::existing_99:head# 2026-02-17T00:52:42.068 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:81490677:::existing_76:head# 2026-02-17T00:52:42.068 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:85ec8e5d:::existing_85:head# 2026-02-17T00:52:42.069 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:8e2abbf0:::existing_49:head# 2026-02-17T00:52:42.069 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:8ee0fe0f:::existing_52:head# 2026-02-17T00:52:42.069 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:923c5d4d:::existing_5:head# 2026-02-17T00:52:42.069 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:92731e71:::existing_89:head# 2026-02-17T00:52:42.069 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:928205cf:::existing_82:head# 2026-02-17T00:52:42.070 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:93be2267:::existing_24:head# 2026-02-17T00:52:42.070 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:99ceda2c:::existing_44:head# 2026-02-17T00:52:42.070 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:9dd917ee:::existing_26:head# 2026-02-17T00:52:42.070 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:a28805a6:::existing_72:head# 2026-02-17T00:52:42.070 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:a294a8f6:::existing_16:head# 2026-02-17T00:52:42.070 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:a2f5473a:::existing_42:head# 2026-02-17T00:52:42.070 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:a504a533:::existing_90:head# 2026-02-17T00:52:42.070 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:a691337e:::existing_61:head# 2026-02-17T00:52:42.070 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:a6e8d7ac:::existing_28:head# 2026-02-17T00:52:42.070 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:a9fde86e:::existing_18:head# 2026-02-17T00:52:42.070 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:aa309faa:::existing_68:head# 2026-02-17T00:52:42.071 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:ae40b0ed:::existing_31:head# 2026-02-17T00:52:42.071 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:b279b1fe:::existing_10:head# 2026-02-17T00:52:42.072 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:b343e277:::existing_88:head# 2026-02-17T00:52:42.072 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:b7130e90:::existing_80:head# 2026-02-17T00:52:42.072 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:bc6f7309:::existing_70:head# 2026-02-17T00:52:42.072 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:be8489b7:::existing_38:head# 2026-02-17T00:52:42.072 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:beb4e5e3:::existing_47:head# 2026-02-17T00:52:42.072 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:bebec877:::existing_74:head# 2026-02-17T00:52:42.072 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:c04347d8:::existing_60:head# 2026-02-17T00:52:42.072 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:c156033e:::existing_100:head# 2026-02-17T00:52:42.073 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:c19f5a8e:::existing_8:head# 2026-02-17T00:52:42.073 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:c3e6ebe4:::existing_17:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:c6c5a7c2:::existing_39:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:cc1d0abf:::existing_95:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:ccb3865b:::existing_73:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:cd84e19e:::existing_40:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:d2cd64ce:::existing_37:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:d41a25c9:::existing_22:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:d7f088da:::existing_91:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:d9cbd1d6:::existing_64:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:dcc4ff82:::existing_98:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:dd677bd3:::existing_35:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:dd6d90e7:::existing_46:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:e0e22077:::existing_21:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:e255b710:::existing_55:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:eff1d5db:::existing_14:head# 2026-02-17T00:52:42.074 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:f1b156bf:::existing_23:head# 2026-02-17T00:52:42.075 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:f5ce4199:::existing_34:head# 2026-02-17T00:52:42.075 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:f6809456:::existing_11:head# 2026-02-17T00:52:42.075 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:f699a2a9:::existing_67:head# 2026-02-17T00:52:42.075 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:f9baac43:::existing_25:head# 2026-02-17T00:52:42.075 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:fb76688e:::existing_51:head# 2026-02-17T00:52:42.075 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:fbb92eec:::existing_69:head# 2026-02-17T00:52:42.075 INFO:tasks.workunit.client.0.trial092.stderr:Export successful 2026-02-17T00:52:42.075 INFO:tasks.workunit.client.0.trial092.stdout: marking collection for removal 2026-02-17T00:52:42.075 INFO:tasks.workunit.client.0.trial092.stdout:setting '_remove' omap key 2026-02-17T00:52:42.075 INFO:tasks.workunit.client.0.trial092.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-17T00:52:42.075 INFO:tasks.workunit.client.0.trial092.stderr:Remove successful 2026-02-17T00:52:42.122 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.44472.out 2026-02-17T00:52:42.122 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T00:52:42.122 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T00:52:42.122 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T00:52:42.122 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T00:52:42.122 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T00:52:42.122 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.44472.out 2026-02-17T00:52:42.232 INFO:tasks.workunit.client.0.trial092.stdout:get_pg_num_history pg_num_history pg_num_history(e47 pg_nums {1={22=1}} deleted_pools ) 2026-02-17T00:52:42.232 INFO:tasks.workunit.client.0.trial092.stdout:Importing pgid 1.0 2026-02-17T00:52:42.232 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-17T00:52:42.232 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:091f9f1d:::existing_94:head# 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:0a865a93:::existing_54:head# 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:0fed513c:::existing_41:head# 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:13b9e0b8:::existing_92:head# 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.233 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:169157fa:::existing_81:head# 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:17731382:::existing_58:head# 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:18a45a39:::existing_43:head# 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:1c160f01:::existing_66:head# 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:1dd6c249:::existing_97:head# 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:227e0c77:::existing_7:head# 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:23e1b063:::existing_59:head# 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.234 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:28566edb:::existing_78:head# 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:2a101182:::existing_20:head# 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:2d1519da:::existing_96:head# 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:3078b87a:::existing_86:head# 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:30bde01b:::existing_15:head# 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:317a7e19:::existing_56:head# 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:38b9c7fa:::existing_33:head# 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.235 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:3e16d84b:::existing_48:head# 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:45fe8203:::existing_75:head# 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:4e82c9ba:::existing_50:head# 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:5298dcdb:::existing_57:head# 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:52ebaa44:::existing_32:head# 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:53588912:::existing_9:head# 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:5b7e2de6:::existing_84:head# 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:5da0255c:::existing_13:head# 2026-02-17T00:52:42.236 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:5da2dab8:::existing_53:head# 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:5ee3514b:::existing_30:head# 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:602f83fe:::foo:head# 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:60426cc7:::existing_62:head# 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:628918ca:::existing_79:head# 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:63f8ab2d:::existing_77:head# 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:67e1780f:::existing_27:head# 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.237 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:68143ca1:::existing_71:head# 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:6bac9509:::existing_29:head# 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:6bbec798:::existing_45:head# 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:6cb23a40:::existing_65:head# 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:7055ec5e:::existing_83:head# 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:70a54e2b:::existing_87:head# 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:750ace21:::existing_19:head# 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:78623b1d:::existing_6:head# 2026-02-17T00:52:42.238 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:79881152:::existing_63:head# 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:7a80c0d5:::existing_99:head# 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:81490677:::existing_76:head# 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:85ec8e5d:::existing_85:head# 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:8e2abbf0:::existing_49:head# 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:8ee0fe0f:::existing_52:head# 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:923c5d4d:::existing_5:head# 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.239 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:92731e71:::existing_89:head# 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:928205cf:::existing_82:head# 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:93be2267:::existing_24:head# 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:99ceda2c:::existing_44:head# 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:9dd917ee:::existing_26:head# 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:a28805a6:::existing_72:head# 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:a294a8f6:::existing_16:head# 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:a2f5473a:::existing_42:head# 2026-02-17T00:52:42.240 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:a504a533:::existing_90:head# 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:a691337e:::existing_61:head# 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:a6e8d7ac:::existing_28:head# 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:a9fde86e:::existing_18:head# 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:aa309faa:::existing_68:head# 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:ae40b0ed:::existing_31:head# 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:b279b1fe:::existing_10:head# 2026-02-17T00:52:42.241 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:b343e277:::existing_88:head# 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:b7130e90:::existing_80:head# 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:bc6f7309:::existing_70:head# 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:be8489b7:::existing_38:head# 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:beb4e5e3:::existing_47:head# 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:bebec877:::existing_74:head# 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:c04347d8:::existing_60:head# 2026-02-17T00:52:42.242 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:c156033e:::existing_100:head# 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:c19f5a8e:::existing_8:head# 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:c3e6ebe4:::existing_17:head# 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:c6c5a7c2:::existing_39:head# 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:cc1d0abf:::existing_95:head# 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:ccb3865b:::existing_73:head# 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:cd84e19e:::existing_40:head# 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.243 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:d2cd64ce:::existing_37:head# 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:d41a25c9:::existing_22:head# 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:d7f088da:::existing_91:head# 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:d9cbd1d6:::existing_64:head# 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:dcc4ff82:::existing_98:head# 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:dd677bd3:::existing_35:head# 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:dd6d90e7:::existing_46:head# 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:e0e22077:::existing_21:head# 2026-02-17T00:52:42.244 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:e255b710:::existing_55:head# 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:eff1d5db:::existing_14:head# 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:f1b156bf:::existing_23:head# 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:f5ce4199:::existing_34:head# 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:f6809456:::existing_11:head# 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:f699a2a9:::existing_67:head# 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:f9baac43:::existing_25:head# 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.245 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:fb76688e:::existing_51:head# 2026-02-17T00:52:42.246 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.246 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:fbb92eec:::existing_69:head# 2026-02-17T00:52:42.246 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:52:42.246 INFO:tasks.workunit.client.0.trial092.stdout:write_pg epoch 47 info 1.0( v 47'102 lc 0'0 (28'90,47'102] local-lis/les=45/46 n=101 ec=22/22 lis/c=45/22 les/c/f=46/23/0 sis=45) 2026-02-17T00:52:42.246 INFO:tasks.workunit.client.0.trial092.stdout:Import successful 2026-02-17T00:52:42.267 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: echo 'reviving divergent 1' 2026-02-17T00:52:42.268 INFO:tasks.workunit.client.0.trial092.stdout:reviving divergent 1 2026-02-17T00:52:42.268 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:580: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:52:42.487 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:52:42.487 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:51:31.428852+0000 40'101 43:135 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T04:50:15.494952+0000 0 0 2026-02-17T00:52:42.487 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:52:42.487 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:52:42.488 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:52:42.497 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-17T00:52:42.497 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:52:42.497 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:52:42.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T00:52:42.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:52:42.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:52:42.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:52:42.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:52:42.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:52:42.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:52:42.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:52:42.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:52:42.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:52:42.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:52:42.499 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:52:42.499 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:52:42.499 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:52:42.499 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:52:42.499 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:52:42.499 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:52:42.499 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:52:42.499 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:52:42.499 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:52:42.499 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:52:42.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:52:42.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:52:42.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:52:42.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:52:42.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:52:42.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:52:42.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:52:42.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:52:42.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:52:42.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T00:52:42.501 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:52:42.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:52:42.502 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T00:52:42.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T00:52:42.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:52:42.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:52:42.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:52:42.515 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:52:42.509+0000 7fd600fe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:52:42.516 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:52:42.511+0000 7fd600fe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:52:42.517 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:52:42.512+0000 7fd600fe3780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:52:42.650 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:52:42.645+0000 7fd600fe3780 -1 Falling back to public interface 2026-02-17T00:52:42.729 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T00:52:42.729 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:52:42.729 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:52:42.729 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:52:42.729 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:52:42.729 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:52:42.729 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:52:42.730 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:52:42.730 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:52:42.730 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:52:42.945 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:52:42.940+0000 7fd600fe3780 -1 osd.1 47 log_to_monitors true 2026-02-17T00:52:42.961 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 30 last_clean_interval [10,28) [v2:127.0.0.1:6818/3543416212,v1:127.0.0.1:6819/3543416212] [v2:127.0.0.1:6820/3543416212,v1:127.0.0.1:6821/3543416212] exists,up e3a77d41-a7b1-4813-9488-a1b9bb60be11 2026-02-17T00:52:42.961 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:52:42.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:52:42.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:52:42.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: wait_for_osd up 1 2026-02-17T00:52:42.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:52:42.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:52:42.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:52:42.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:52:42.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:52:42.962 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:52:42.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:52:42.963 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:52:42.963 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:52:43.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:52:44.194 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:52:44.194 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:52:44.194 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:52:44.195 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:52:44.195 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:52:44.195 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:52:44.426 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 49 last_clean_interval [45,47) [v2:127.0.0.1:6818/435349724,v1:127.0.0.1:6819/435349724] [v2:127.0.0.1:6820/435349724,v1:127.0.0.1:6821/435349724] exists,up e3a77d41-a7b1-4813-9488-a1b9bb60be11 2026-02-17T00:52:44.427 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:52:44.427 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:52:44.427 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:52:44.428 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: sleep 20 2026-02-17T00:53:04.429 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: get_asok_path osd.1 2026-02-17T00:53:04.429 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T00:53:04.429 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T00:53:04.429 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:53:04.429 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:04.429 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:04.429 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.1.asok 2026-02-17T00:53:04.430 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: CEPH_ARGS= 2026-02-17T00:53:04.430 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T00:53:04.473 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:53:04.473 INFO:tasks.workunit.client.0.trial092.stdout: "ops": [], 2026-02-17T00:53:04.473 INFO:tasks.workunit.client.0.trial092.stdout: "num_ops": 0 2026-02-17T00:53:04.474 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:53:04.476 INFO:tasks.workunit.client.0.trial092.stdout:allowing recovery 2026-02-17T00:53:04.477 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: echo 'allowing recovery' 2026-02-17T00:53:04.477 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:588: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:53:04.692 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:53:04.692 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-17T00:52:44.028571+0000 47'102 51:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T05:34:32.821658+0000 0 0 2026-02-17T00:53:04.692 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:53:04.692 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:53:04.692 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:53:04.699 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-17T00:53:04.699 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T00:53:04.762 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:53:04.767 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-17T00:53:04.767 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T00:53:04.829 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:53:04.834 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-17T00:53:04.835 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T00:53:04.895 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:53:04.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:595: TEST_divergent_2: echo 'reading divergent objects' 2026-02-17T00:53:04.901 INFO:tasks.workunit.client.0.trial092.stdout:reading divergent objects 2026-02-17T00:53:04.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: ceph pg dump pgs 2026-02-17T00:53:05.119 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:53:05.119 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-17T00:52:44.028571+0000 47'102 51:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:51:00.560053+0000 0'0 2026-02-17T00:51:00.560053+0000 0 0 periodic scrub scheduled @ 2026-02-18T05:34:32.821658+0000 0 0 2026-02-17T00:53:05.119 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:53:05.119 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:53:05.119 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:53:05.127 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: expr 2 + 2 2026-02-17T00:53:05.128 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: seq 1 4 2026-02-17T00:53:05.128 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:53:05.129 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T00:53:05.148 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:53:05.148 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T00:53:05.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:53:05.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T00:53:05.185 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:53:05.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T00:53:05.203 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: seq 1 2 2026-02-17T00:53:05.204 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T00:53:05.204 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-17T00:53:05.222 INFO:tasks.workunit.client.0.trial092.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-17T00:53:05.223 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T00:53:05.223 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-17T00:53:05.240 INFO:tasks.workunit.client.0.trial092.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-17T00:53:05.242 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:605: TEST_divergent_2: rm -f td/divergent-priors/existing 2026-02-17T00:53:05.243 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T00:53:05.244 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-17T00:53:05.246 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4545.0:1 2026-02-17T00:51:15.412990+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T00:53:05.247 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: keeping 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4545.0:1 2026-02-17T00:51:15.412990+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T00:53:05.247 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:53:05.247 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 28'4 first_divergent_update: 28'106 last_divergent_update: 28'106 2026-02-17T00:53:05.247 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: more recent entry found: 40'101 (28'4) modify 1:70b3bf12:::existing_4:head by client.4654.0:1 2026-02-17T00:52:02.065446+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-17T00:53:05.247 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 28'104 (0'0) modify 1:75ac5091:::newobject_2:head by client.4541.0:1 2026-02-17T00:51:15.409442+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T00:53:05.247 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: keeping 28'104 (0'0) modify 1:75ac5091:::newobject_2:head by client.4541.0:1 2026-02-17T00:51:15.409442+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T00:53:05.247 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:53:05.247 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-17T00:53:05.248 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-17T00:53:05.248 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-17T00:53:05.248 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4542.0:1 2026-02-17T00:51:15.410524+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T00:53:05.248 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: keeping 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4542.0:1 2026-02-17T00:51:15.410524+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T00:53:05.248 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-17T00:53:05.248 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 28'3 first_divergent_update: 28'105 last_divergent_update: 28'105 2026-02-17T00:53:05.248 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-17T00:53:05.248 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-17T00:53:05.248 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 28'106 2026-02-17T00:53:05.248 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4542.0:1 2026-02-17T00:51:15.410524+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T00:53:05.249 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-17T00:53:05.249 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 28'3 <= info.log_tail 28'90 2026-02-17T00:53:05.249 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4538.0:1 2026-02-17T00:51:15.408583+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:53:05.249 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: keeping 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4538.0:1 2026-02-17T00:51:15.408583+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:53:05.249 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:53:05.249 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 28'2 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-17T00:53:05.249 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-17T00:53:05.249 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-17T00:53:05.249 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 28'106 2026-02-17T00:53:05.249 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4538.0:1 2026-02-17T00:51:15.408583+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:53:05.249 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-17T00:53:05.250 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 28'2 <= info.log_tail 28'90 2026-02-17T00:53:05.250 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 28'102 (28'1) modify 1:d858c035:::existing_1:head by client.4534.0:1 2026-02-17T00:51:15.406803+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:53:05.250 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: keeping 28'102 (28'1) modify 1:d858c035:::existing_1:head by client.4534.0:1 2026-02-17T00:51:15.406803+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:53:05.250 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:53:05.251 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 28'1 first_divergent_update: 28'102 last_divergent_update: 28'102 2026-02-17T00:53:05.251 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-17T00:53:05.251 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-17T00:53:05.251 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 28'106 2026-02-17T00:53:05.251 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 28'102 (28'1) modify 1:d858c035:::existing_1:head by client.4534.0:1 2026-02-17T00:51:15.406803+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:53:05.251 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-17T00:53:05.251 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 28'1 <= info.log_tail 28'90 2026-02-17T00:53:05.251 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 28'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4531.0:1 2026-02-17T00:51:15.405429+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T00:53:05.251 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 20 _merge_object_divergent_entries: keeping 28'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4531.0:1 2026-02-17T00:51:15.405429+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T00:53:05.251 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:53:05.252 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-17T00:53:05.252 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-17T00:53:05.252 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:52:40.547+0000 7fa4d518c640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-17T00:53:05.252 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T00:53:05.252 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-17T00:53:05.253 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T00:53:05.253 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-17T00:53:05.255 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:620: TEST_divergent_2: echo success 2026-02-17T00:53:05.255 INFO:tasks.workunit.client.0.trial092.stdout:success 2026-02-17T00:53:05.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.44472.out 2026-02-17T00:53:05.256 INFO:tasks.workunit.client.0.trial092.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.44472.out': No such file or directory 2026-02-17T00:53:05.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:623: TEST_divergent_2: delete_pool test 2026-02-17T00:53:05.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T00:53:05.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T00:53:05.530 INFO:tasks.workunit.client.0.trial092.stderr:pool 'test' does not exist 2026-02-17T00:53:05.538 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:624: TEST_divergent_2: kill_daemons td/divergent-priors 2026-02-17T00:53:05.538 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:53:05.538 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:53:05.538 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:53:05.539 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:53:05.539 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:53:10.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:53:10.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T00:53:10.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T00:53:10.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:53:10.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T00:53:10.853 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:53:10.853 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:53:10.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:53:10.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:53:10.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:53:10.858 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:53:10.859 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:53:10.859 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:53:10.859 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:53:10.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:53:10.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:53:10.861 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:53:10.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:53:10.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:53:10.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:53:10.862 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:53:10.863 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:53:10.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:53:10.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T00:53:10.878 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:53:10.878 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:10.878 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:10.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44472 2026-02-17T00:53:10.880 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:53:10.880 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:53:10.880 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T00:53:10.880 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T00:53:10.880 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T00:53:10.880 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T00:53:10.881 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T00:53:10.881 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:53:10.881 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T00:53:10.881 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:53:10.881 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:53:10.881 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:53:10.881 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:53:10.882 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:53:10.882 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:53:10.882 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:53:10.883 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:53:10.883 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:53:10.883 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:53:10.883 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:53:10.884 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:53:10.884 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:53:10.884 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:53:10.885 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:53:10.885 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:53:10.885 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:53:10.886 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:53:10.886 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T00:53:10.888 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:53:10.888 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:10.888 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:10.888 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44472 2026-02-17T00:53:10.889 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:53:10.889 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:53:10.889 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T00:53:10.890 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T00:53:10.890 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:10.890 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:10.890 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.44472 2026-02-17T00:53:10.891 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T00:53:10.892 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T00:53:10.892 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T00:53:10.892 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T00:53:10.892 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2026-02-17T00:53:10.893 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:630: TEST_divergent_3: local dir=td/divergent-priors 2026-02-17T00:53:10.893 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: file_with_random_data 2026-02-17T00:53:10.893 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T00:53:10.893 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T00:53:10.893 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:10.893 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.IdZzGNRuJ6 bs=512 count=1 2026-02-17T00:53:10.894 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records in 2026-02-17T00:53:10.895 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records out 2026-02-17T00:53:10.895 INFO:tasks.workunit.client.0.trial092.stderr:512 bytes copied, 5.3149e-05 s, 9.6 MB/s 2026-02-17T00:53:10.895 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:10.895 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile=/tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:10.895 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: file_with_random_data 1000 2026-02-17T00:53:10.895 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-17T00:53:10.896 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T00:53:10.896 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.T13Jc6reTs 2026-02-17T00:53:10.896 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.T13Jc6reTs bs=1000 count=1 2026-02-17T00:53:10.897 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records in 2026-02-17T00:53:10.897 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records out 2026-02-17T00:53:10.897 INFO:tasks.workunit.client.0.trial092.stderr:1000 bytes (1.0 kB) copied, 4.6917e-05 s, 21.3 MB/s 2026-02-17T00:53:10.897 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.T13Jc6reTs 2026-02-17T00:53:10.897 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local dummyfile2=/tmp/tmp.T13Jc6reTs 2026-02-17T00:53:10.897 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: local num_osds=3 2026-02-17T00:53:10.898 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: expr 3 - 1 2026-02-17T00:53:10.898 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: seq 0 2 2026-02-17T00:53:10.899 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: local 'osds=0 2026-02-17T00:53:10.899 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:53:10.900 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:53:10.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: run_mon td/divergent-priors a 2026-02-17T00:53:10.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T00:53:10.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T00:53:10.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T00:53:10.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T00:53:10.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T00:53:10.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T00:53:10.919 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T00:53:10.919 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:53:10.919 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:53:10.919 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:53:10.920 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:10.920 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:10.920 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:10.920 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T00:53:10.946 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T00:53:10.948 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T00:53:10.948 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:53:10.948 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:53:10.948 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T00:53:10.948 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T00:53:10.948 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:53:10.948 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:53:10.948 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:53:10.948 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:53:10.948 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:10.949 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:10.949 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-mon.a.asok 2026-02-17T00:53:10.949 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:53:10.949 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.44472/ceph-mon.a.asok config get fsid 2026-02-17T00:53:10.991 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T00:53:10.991 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:53:10.991 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:53:10.991 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T00:53:10.991 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T00:53:10.991 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:53:10.991 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:53:10.991 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:53:10.991 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:53:10.992 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:10.992 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:10.992 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-mon.a.asok 2026-02-17T00:53:10.992 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:53:10.992 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.44472/ceph-mon.a.asok config get mon_host 2026-02-17T00:53:11.033 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:639: TEST_divergent_3: run_mgr td/divergent-priors x 2026-02-17T00:53:11.033 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T00:53:11.034 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T00:53:11.034 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T00:53:11.034 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T00:53:11.034 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T00:53:11.034 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T00:53:11.139 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T00:53:11.139 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:53:11.139 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:53:11.139 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:53:11.140 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:11.140 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:11.140 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:11.140 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:53:11.141 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:53:11.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-17T00:53:11.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 0 2026-02-17T00:53:11.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:53:11.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:53:11.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T00:53:11.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:53:11.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:11.160 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:11.162 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:11.162 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:11.162 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:53:11.162 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:53:11.162 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=44365f2e-8c44-4cf8-9dc2-0f1042f6586a 2026-02-17T00:53:11.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 44365f2e-8c44-4cf8-9dc2-0f1042f6586a' 2026-02-17T00:53:11.164 INFO:tasks.workunit.client.0.trial092.stdout:add osd0 44365f2e-8c44-4cf8-9dc2-0f1042f6586a 2026-02-17T00:53:11.164 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:53:11.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD3u5Npbi0sChAAVh8GicOa+RBC2uahqOJhbQ== 2026-02-17T00:53:11.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD3u5Npbi0sChAAVh8GicOa+RBC2uahqOJhbQ=="}' 2026-02-17T00:53:11.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 44365f2e-8c44-4cf8-9dc2-0f1042f6586a -i td/divergent-priors/0/new.json 2026-02-17T00:53:11.281 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:53:11.288 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T00:53:11.289 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD3u5Npbi0sChAAVh8GicOa+RBC2uahqOJhbQ== --osd-uuid 44365f2e-8c44-4cf8-9dc2-0f1042f6586a 2026-02-17T00:53:11.308 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:11.303+0000 7f65cc210780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:11.309 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:11.305+0000 7f65cc210780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:11.310 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:11.306+0000 7f65cc210780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:11.311 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:11.306+0000 7f65cc210780 -1 bdev(0x330ac00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T00:53:11.311 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:11.306+0000 7f65cc210780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T00:53:11.778 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T00:53:11.778 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:53:11.779 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T00:53:11.779 INFO:tasks.workunit.client.0.trial092.stdout:adding osd0 key to auth repository 2026-02-17T00:53:11.779 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:53:11.888 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:53:11.888 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T00:53:11.888 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:53:11.888 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:53:11.888 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:53:11.888 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:53:11.907 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:11.902+0000 7f16ae857780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:11.908 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:11.903+0000 7f16ae857780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:11.909 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:11.904+0000 7f16ae857780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:11.990 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T00:53:11.991 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:53:11.991 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:53:11.991 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:53:11.991 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:53:11.991 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:53:11.991 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:53:11.991 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:53:11.991 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:53:11.991 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:53:12.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:53:12.140 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:12.136+0000 7f16ae857780 -1 Falling back to public interface 2026-02-17T00:53:12.631 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:12.626+0000 7f16ae857780 -1 osd.0 0 log_to_monitors true 2026-02-17T00:53:13.091 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:53:13.091 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:53:13.091 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:53:13.092 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:53:13.092 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:53:13.092 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:53:13.190 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:53:14.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:53:14.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:53:14.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T00:53:14.192 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T00:53:14.193 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:53:14.193 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:53:14.428 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/235330143,v1:127.0.0.1:6801/235330143] [v2:127.0.0.1:6802/235330143,v1:127.0.0.1:6803/235330143] exists,up 44365f2e-8c44-4cf8-9dc2-0f1042f6586a 2026-02-17T00:53:14.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:53:14.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:53:14.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:53:14.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-17T00:53:14.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 1 2026-02-17T00:53:14.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:53:14.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:53:14.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T00:53:14.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:53:14.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:53:14.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:53:14.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:53:14.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:53:14.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:14.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:53:14.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:53:14.436 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:53:14.436 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=88cb08c5-e268-4844-904f-02be0aa73443 2026-02-17T00:53:14.436 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 88cb08c5-e268-4844-904f-02be0aa73443' 2026-02-17T00:53:14.436 INFO:tasks.workunit.client.0.trial092.stdout:add osd1 88cb08c5-e268-4844-904f-02be0aa73443 2026-02-17T00:53:14.436 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:53:14.444 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD6u5NpRkE7GhAAnP5K4bKudV+V7N+wo6abiA== 2026-02-17T00:53:14.444 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD6u5NpRkE7GhAAnP5K4bKudV+V7N+wo6abiA=="}' 2026-02-17T00:53:14.444 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 88cb08c5-e268-4844-904f-02be0aa73443 -i td/divergent-priors/1/new.json 2026-02-17T00:53:14.690 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:53:14.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T00:53:14.698 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD6u5NpRkE7GhAAnP5K4bKudV+V7N+wo6abiA== --osd-uuid 88cb08c5-e268-4844-904f-02be0aa73443 2026-02-17T00:53:14.718 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:14.714+0000 7f02feb3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:14.720 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:14.715+0000 7f02feb3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:14.721 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:14.716+0000 7f02feb3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:14.721 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:14.716+0000 7f02feb3d780 -1 bdev(0x38e8c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T00:53:14.721 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:14.716+0000 7f02feb3d780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T00:53:15.037 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T00:53:15.037 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:53:15.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T00:53:15.038 INFO:tasks.workunit.client.0.trial092.stdout:adding osd1 key to auth repository 2026-02-17T00:53:15.039 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:53:15.362 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T00:53:15.363 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:53:15.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:53:15.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:53:15.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:53:15.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:53:15.382 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:15.377+0000 7fc9b9e56780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:15.384 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:15.379+0000 7fc9b9e56780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:15.384 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:15.380+0000 7fc9b9e56780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:15.531 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:15.526+0000 7fc9b9e56780 -1 Falling back to public interface 2026-02-17T00:53:15.595 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T00:53:15.596 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:53:15.596 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:53:15.596 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:53:15.596 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:53:15.596 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:53:15.596 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:53:15.596 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:53:15.596 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:53:15.596 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:53:15.815 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:15.810+0000 7fc9b9e56780 -1 osd.1 0 log_to_monitors true 2026-02-17T00:53:15.832 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:53:16.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:53:16.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:53:16.834 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:53:16.834 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:53:16.834 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:53:16.835 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:53:17.076 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/306387533,v1:127.0.0.1:6811/306387533] [v2:127.0.0.1:6812/306387533,v1:127.0.0.1:6813/306387533] exists,up 88cb08c5-e268-4844-904f-02be0aa73443 2026-02-17T00:53:17.080 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:53:17.080 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:53:17.080 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:53:17.080 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-17T00:53:17.080 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 2 2026-02-17T00:53:17.080 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:53:17.080 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:53:17.080 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T00:53:17.080 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:53:17.081 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:53:17.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:53:17.083 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:53:17.083 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:53:17.083 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:53:17.083 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T00:53:17.083 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:53:17.083 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a0cd068a-c54e-4e63-b6cd-541c4749bcdb 2026-02-17T00:53:17.083 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 a0cd068a-c54e-4e63-b6cd-541c4749bcdb' 2026-02-17T00:53:17.083 INFO:tasks.workunit.client.0.trial092.stdout:add osd2 a0cd068a-c54e-4e63-b6cd-541c4749bcdb 2026-02-17T00:53:17.084 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:53:17.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQD9u5Npx7hMBRAAAm75yJYKnEE6vurqgncdnA== 2026-02-17T00:53:17.094 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQD9u5Npx7hMBRAAAm75yJYKnEE6vurqgncdnA=="}' 2026-02-17T00:53:17.094 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a0cd068a-c54e-4e63-b6cd-541c4749bcdb -i td/divergent-priors/2/new.json 2026-02-17T00:53:17.329 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T00:53:17.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T00:53:17.337 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD9u5Npx7hMBRAAAm75yJYKnEE6vurqgncdnA== --osd-uuid a0cd068a-c54e-4e63-b6cd-541c4749bcdb 2026-02-17T00:53:17.358 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:17.353+0000 7f4bd864d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:17.359 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:17.354+0000 7f4bd864d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:17.360 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:17.355+0000 7f4bd864d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:17.360 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:17.355+0000 7f4bd864d780 -1 bdev(0x33fec00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T00:53:17.360 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:17.355+0000 7f4bd864d780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T00:53:17.678 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T00:53:17.678 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:53:17.679 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T00:53:17.679 INFO:tasks.workunit.client.0.trial092.stdout:adding osd2 key to auth repository 2026-02-17T00:53:17.679 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:53:18.017 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T00:53:18.018 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:53:18.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:53:18.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:53:18.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:53:18.019 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:53:18.037 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:18.032+0000 7f966606a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:18.038 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:18.033+0000 7f966606a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:18.039 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:18.034+0000 7f966606a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:18.158 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:18.153+0000 7f966606a780 -1 Falling back to public interface 2026-02-17T00:53:18.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T00:53:18.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:53:18.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:53:18.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:53:18.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:53:18.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:53:18.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:53:18.259 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:53:18.259 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:53:18.259 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:53:18.451 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:18.446+0000 7f966606a780 -1 osd.2 0 log_to_monitors true 2026-02-17T00:53:18.488 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:53:19.490 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:53:19.490 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:53:19.491 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:53:19.491 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:53:19.492 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:53:19.492 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:53:19.720 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3744388125,v1:127.0.0.1:6819/3744388125] [v2:127.0.0.1:6820/3744388125,v1:127.0.0.1:6821/3744388125] exists,up a0cd068a-c54e-4e63-b6cd-541c4749bcdb 2026-02-17T00:53:19.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:53:19.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:53:19.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:53:19.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set noout 2026-02-17T00:53:20.004 INFO:tasks.workunit.client.0.trial092.stderr:noout is set 2026-02-17T00:53:20.013 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: ceph osd set noin 2026-02-17T00:53:20.308 INFO:tasks.workunit.client.0.trial092.stderr:noin is set 2026-02-17T00:53:20.318 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd set nodown 2026-02-17T00:53:20.611 INFO:tasks.workunit.client.0.trial092.stderr:nodown is set 2026-02-17T00:53:20.622 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: create_pool test 1 1 2026-02-17T00:53:20.623 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-17T00:53:20.876 INFO:tasks.workunit.client.0.trial092.stderr:pool 'test' already exists 2026-02-17T00:53:20.884 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T00:53:21.885 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:649: TEST_divergent_3: ceph osd pool set test size 3 2026-02-17T00:53:22.200 INFO:tasks.workunit.client.0.trial092.stderr:set pool 1 size to 3 2026-02-17T00:53:22.208 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:650: TEST_divergent_3: ceph osd pool set test min_size 2 2026-02-17T00:53:22.503 INFO:tasks.workunit.client.0.trial092.stderr:set pool 1 min_size to 2 2026-02-17T00:53:22.513 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2026-02-17T00:53:22.807 INFO:tasks.workunit.client.0.trial092.stderr:set pool 1 pg_autoscale_mode to on 2026-02-17T00:53:22.815 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:655: TEST_divergent_3: divergent=-1 2026-02-17T00:53:22.816 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: date +%s 2026-02-17T00:53:22.817 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: start_time=1771289602 2026-02-17T00:53:22.817 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: max_duration=300 2026-02-17T00:53:22.817 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' -1 -le -1 ']' 2026-02-17T00:53:22.817 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: flush_pg_stats 2026-02-17T00:53:22.817 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:53:22.817 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:53:23.045 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:53:23.045 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:53:23.045 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:53:23.045 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:53:23.045 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:23.045 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:53:23.112 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-17T00:53:23.113 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-17T00:53:23.113 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-17T00:53:23.113 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:23.113 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:53:23.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-17T00:53:23.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-17T00:53:23.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-38654705668' 2026-02-17T00:53:23.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:23.180 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:53:23.248 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-17T00:53:23.248 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-17T00:53:23.248 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-38654705668 2-55834574851' 2026-02-17T00:53:23.248 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:53:23.248 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-17T00:53:23.249 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:53:23.249 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:53:23.250 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-17T00:53:23.250 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:53:23.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-17T00:53:23.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-17T00:53:23.251 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836484 2026-02-17T00:53:23.252 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:53:23.484 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-17T00:53:23.484 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:53:23.484 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705668 2026-02-17T00:53:23.484 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:53:23.485 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:53:23.486 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-17T00:53:23.486 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:53:23.487 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705668 2026-02-17T00:53:23.487 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-17T00:53:23.487 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 38654705668 2026-02-17T00:53:23.487 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:53:23.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-17T00:53:23.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:53:23.717 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574851 2026-02-17T00:53:23.717 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:53:23.718 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:53:23.718 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-17T00:53:23.718 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:53:23.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574851 2026-02-17T00:53:23.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-17T00:53:23.720 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 55834574851 2026-02-17T00:53:23.720 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:53:23.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574849 -lt 55834574851 2026-02-17T00:53:23.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:53:24.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:53:24.952 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:53:25.185 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574849 -lt 55834574851 2026-02-17T00:53:25.185 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:53:26.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T00:53:26.186 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:53:26.417 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574852 -lt 55834574851 2026-02-17T00:53:26.417 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:662: TEST_divergent_3: wait_for_clean 2026-02-17T00:53:26.417 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:53:26.418 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:53:26.418 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:53:26.418 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T00:53:26.419 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:53:26.419 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:53:26.419 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:53:26.419 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:53:26.419 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:53:26.504 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T00:53:26.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:53:26.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:53:26.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:53:26.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:53:26.505 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:53:26.735 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:53:26.736 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:53:26.736 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:53:26.736 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:53:26.736 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:26.736 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:53:26.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T00:53:26.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T00:53:26.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T00:53:26.803 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:26.803 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:53:26.870 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-17T00:53:26.870 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-17T00:53:26.870 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-17T00:53:26.870 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:26.870 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:53:26.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-17T00:53:26.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-17T00:53:26.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-55834574854' 2026-02-17T00:53:26.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:53:26.941 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T00:53:26.941 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:53:26.941 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:53:26.942 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T00:53:26.942 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:53:26.943 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T00:53:26.943 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T00:53:26.944 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836487 2026-02-17T00:53:26.944 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:53:27.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T00:53:27.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:53:28.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:53:28.174 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:53:28.406 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T00:53:28.406 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:53:28.406 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705670 2026-02-17T00:53:28.406 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:53:28.407 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:53:28.408 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-17T00:53:28.408 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:53:28.409 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705670 2026-02-17T00:53:28.409 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-17T00:53:28.409 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 38654705670 2026-02-17T00:53:28.409 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:53:28.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705671 -lt 38654705670 2026-02-17T00:53:28.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:53:28.638 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574854 2026-02-17T00:53:28.638 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:53:28.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:53:28.639 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-17T00:53:28.640 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:53:28.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574854 2026-02-17T00:53:28.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-17T00:53:28.641 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 55834574854 2026-02-17T00:53:28.641 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:53:28.867 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-17T00:53:28.868 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:53:28.868 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:53:28.868 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:53:29.188 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:53:29.188 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:53:29.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:53:29.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:53:29.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:53:29.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:53:29.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:53:29.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:53:29.422 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T00:53:29.423 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:53:29.423 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:53:29.423 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:53:29.745 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T00:53:29.745 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T00:53:29.746 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T00:53:29.746 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: ceph pg dump pgs --format=json 2026-02-17T00:53:29.747 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2026-02-17T00:53:29.968 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:53:29.976 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: divergent=1 2026-02-17T00:53:29.976 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2026-02-17T00:53:29.977 INFO:tasks.workunit.client.0.trial092.stdout:primary and soon to be divergent is 1 2026-02-17T00:53:29.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:53:30.199 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:53:30.199 INFO:tasks.workunit.client.0.trial092.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T00:53:21.434927+0000 0'0 28:28 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:01:30.690309+0000 0 0 2026-02-17T00:53:30.199 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:53:30.199 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:53:30.200 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:53:30.206 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: date +%s 2026-02-17T00:53:30.207 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: current_time=1771289610 2026-02-17T00:53:30.207 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: expr 1771289610 - 1771289602 2026-02-17T00:53:30.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: elapsed_time=8 2026-02-17T00:53:30.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: '[' 8 -gt 300 ']' 2026-02-17T00:53:30.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' 1 -le -1 ']' 2026-02-17T00:53:30.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:677: TEST_divergent_3: local non_divergent= 2026-02-17T00:53:30.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-17T00:53:30.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 0 = 1 ']' 2026-02-17T00:53:30.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0' 2026-02-17T00:53:30.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-17T00:53:30.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 1 = 1 ']' 2026-02-17T00:53:30.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: continue 2026-02-17T00:53:30.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-17T00:53:30.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 2 = 1 ']' 2026-02-17T00:53:30.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0 2' 2026-02-17T00:53:30.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: echo 'writing initial objects' 2026-02-17T00:53:30.211 INFO:tasks.workunit.client.0.trial092.stdout:writing initial objects 2026-02-17T00:53:30.211 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: seq 1 100 2026-02-17T00:53:30.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.230 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.231 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.249 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.249 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_3 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.268 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.268 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.287 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.287 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_5 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.306 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.306 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_6 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.325 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.325 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_7 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.343 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.343 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_8 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.362 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_9 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.381 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.381 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_10 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.399 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.400 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_11 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.419 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.419 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_12 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.437 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.437 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_13 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_14 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.474 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.474 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_15 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.493 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.493 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_16 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.511 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.511 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_17 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.529 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.530 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_18 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.548 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.548 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_19 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.567 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.567 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_20 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.586 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.586 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_21 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.605 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.605 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_22 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.623 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.623 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_23 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.642 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_24 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_25 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.680 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.680 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_26 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_27 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_28 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.738 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.738 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_29 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_30 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.777 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.778 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_31 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.797 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_32 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.816 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.816 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_33 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.834 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.834 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_34 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_35 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_36 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.891 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.891 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_37 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.910 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.910 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_38 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.928 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.928 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_39 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.946 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.946 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_40 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.966 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_41 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:30.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:30.986 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_42 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.004 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.004 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_43 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.022 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.022 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_44 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.041 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.041 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_45 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_46 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.078 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.078 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_47 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.098 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.098 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_48 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.116 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.116 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_49 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.136 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.136 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_50 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.155 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.155 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_51 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.174 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.174 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_52 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.193 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.193 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_53 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_54 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.232 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.232 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_55 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_56 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_57 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.289 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.289 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_58 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.307 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.307 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_59 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.325 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_60 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_61 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_62 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.382 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.382 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_63 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.402 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.402 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_64 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.421 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.421 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_65 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.439 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.439 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_66 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.457 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.457 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_67 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.476 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.476 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_68 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_69 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.513 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.513 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_70 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.532 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.532 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_71 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.551 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.551 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_72 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.569 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.569 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_73 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.587 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.588 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_74 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.606 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.606 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_75 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.625 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.625 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_76 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.643 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.643 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_77 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_78 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.680 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.680 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_79 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.698 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.698 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_80 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_81 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.736 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.736 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_82 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.754 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.755 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_83 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_84 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.792 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.792 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_85 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.811 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.811 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_86 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.830 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.830 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_87 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.849 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.849 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_88 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.868 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.868 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_89 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.886 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.886 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_90 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.905 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.905 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_91 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_92 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.943 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.943 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_93 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.961 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.961 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_94 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_95 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:31.999 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:31.999 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_96 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:32.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:32.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_97 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:32.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:32.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_98 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:32.057 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:32.057 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_99 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:32.076 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T00:53:32.076 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_100 /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:53:32.096 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T00:53:32.096 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: wait_for_clean 2026-02-17T00:53:32.096 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:53:32.096 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:53:32.096 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:53:32.096 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T00:53:32.097 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:53:32.097 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:53:32.097 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:53:32.097 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:53:32.098 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:53:32.150 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T00:53:32.150 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:53:32.150 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:53:32.150 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:53:32.150 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:53:32.151 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:53:32.380 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:53:32.381 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:53:32.381 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:53:32.381 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:53:32.381 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:32.381 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:53:32.447 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-17T00:53:32.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-17T00:53:32.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T00:53:32.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:32.448 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:53:32.514 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T00:53:32.515 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T00:53:32.515 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705674' 2026-02-17T00:53:32.515 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:32.515 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:53:32.581 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-17T00:53:32.581 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-17T00:53:32.581 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705674 2-55834574857' 2026-02-17T00:53:32.581 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:53:32.582 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-17T00:53:32.582 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:53:32.582 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:53:32.583 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-17T00:53:32.583 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:53:32.584 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-17T00:53:32.584 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T00:53:32.585 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836490 2026-02-17T00:53:32.585 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:53:32.814 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-17T00:53:32.814 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:53:33.815 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:53:33.816 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:53:34.050 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-17T00:53:34.050 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:53:34.050 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T00:53:34.051 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:53:34.051 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:53:34.052 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T00:53:34.052 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:53:34.053 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T00:53:34.053 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T00:53:34.053 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 38654705674 2026-02-17T00:53:34.053 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:53:34.287 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T00:53:34.287 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:53:34.287 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-55834574857 2026-02-17T00:53:34.287 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:53:34.288 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:53:34.289 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-17T00:53:34.289 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:53:34.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574857 2026-02-17T00:53:34.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-17T00:53:34.290 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 55834574857 2026-02-17T00:53:34.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:53:34.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-17T00:53:34.522 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:53:34.522 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:53:34.522 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:53:34.842 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:53:34.842 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:53:34.842 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:53:34.842 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:53:34.842 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:53:34.842 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:53:34.842 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:53:34.842 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:53:35.072 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T00:53:35.073 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:53:35.073 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:53:35.073 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:53:35.394 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T00:53:35.395 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T00:53:35.395 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T00:53:35.395 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: get_pg test existing_1 2026-02-17T00:53:35.395 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T00:53:35.395 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T00:53:35.395 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T00:53:35.395 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T00:53:35.626 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: local pgid=1.0 2026-02-17T00:53:35.626 INFO:tasks.workunit.client.0.trial092.stdout:blackholing osds 0 2 2026-02-17T00:53:35.627 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: echo 'blackholing osds 0 2' 2026-02-17T00:53:35.627 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:699: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:53:35.845 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:53:35.845 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T00:53:21.434927+0000 28'100 28:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:01:30.690309+0000 0 0 2026-02-17T00:53:35.845 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:53:35.845 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:53:35.845 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:53:35.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-17T00:53:35.853 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.0 2026-02-17T00:53:35.853 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T00:53:35.853 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T00:53:35.853 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:53:35.853 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:35.854 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:35.854 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.0.asok 2026-02-17T00:53:35.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-17T00:53:35.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T00:53:35.897 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:53:35.897 INFO:tasks.workunit.client.0.trial092.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T00:53:35.897 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:53:35.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-17T00:53:35.901 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.2 2026-02-17T00:53:35.901 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T00:53:35.901 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T00:53:35.901 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:53:35.901 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:35.902 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:35.902 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.2.asok 2026-02-17T00:53:35.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-17T00:53:35.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T00:53:35.943 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:53:35.943 INFO:tasks.workunit.client.0.trial092.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T00:53:35.943 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:53:35.947 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:706: TEST_divergent_3: echo 'create new divergent objects' 2026-02-17T00:53:35.947 INFO:tasks.workunit.client.0.trial092.stdout:create new divergent objects 2026-02-17T00:53:35.947 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: seq 1 2 2026-02-17T00:53:35.948 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T00:53:35.948 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T00:53:35.948 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_1 2026-02-17T00:53:35.948 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:712: TEST_divergent_3: echo 'writing divergent objects' 2026-02-17T00:53:35.949 INFO:tasks.workunit.client.0.trial092.stdout:writing divergent objects 2026-02-17T00:53:35.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_2 2026-02-17T00:53:35.949 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: seq 1 2 2026-02-17T00:53:35.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T00:53:35.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T00:53:35.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.T13Jc6reTs 2026-02-17T00:53:35.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: echo 'remove divergent objects' 2026-02-17T00:53:35.951 INFO:tasks.workunit.client.0.trial092.stdout:remove divergent objects 2026-02-17T00:53:35.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.T13Jc6reTs 2026-02-17T00:53:35.951 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: seq 1 2 2026-02-17T00:53:35.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T00:53:35.952 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 1 + 2 2026-02-17T00:53:35.952 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=3 2026-02-17T00:53:35.952 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T00:53:35.952 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_3 2026-02-17T00:53:35.953 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 2 + 2 2026-02-17T00:53:35.954 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=4 2026-02-17T00:53:35.954 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:724: TEST_divergent_3: sleep 10 2026-02-17T00:53:35.954 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_4 2026-02-17T00:53:45.955 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:725: TEST_divergent_3: killall -9 rados 2026-02-17T00:53:45.988 INFO:tasks.workunit.client.0.trial092.stderr:rados: no process found 2026-02-17T00:53:45.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: echo 'killing all the osds' 2026-02-17T00:53:45.988 INFO:tasks.workunit.client.0.trial092.stdout:killing all the osds 2026-02-17T00:53:45.989 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:53:46.207 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:53:46.207 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-17T00:53:21.434927+0000 28'106 28:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:01:30.690309+0000 0 0 2026-02-17T00:53:46.207 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:53:46.208 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:53:46.208 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:53:46.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2026-02-17T00:53:46.215 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:53:46.215 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:53:46.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:53:46.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:53:46.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:53:46.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:53:46.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-17T00:53:46.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.0 2026-02-17T00:53:46.605 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already down. 2026-02-17T00:53:46.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-17T00:53:46.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.1 2026-02-17T00:53:46.894 INFO:tasks.workunit.client.0.trial092.stderr:osd.1 is already down. 2026-02-17T00:53:46.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-17T00:53:46.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.2 2026-02-17T00:53:47.182 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already down. 2026-02-17T00:53:47.191 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-17T00:53:47.191 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.0 2026-02-17T00:53:47.473 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already out. 2026-02-17T00:53:47.480 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-17T00:53:47.480 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.2 2026-02-17T00:53:47.759 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already out. 2026-02-17T00:53:47.766 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2026-02-17T00:53:47.766 INFO:tasks.workunit.client.0.trial092.stdout:bringing up non_divergent 0 2 2026-02-17T00:53:47.766 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:742: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:53:47.987 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:53:47.987 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-17T00:53:21.434927+0000 28'106 28:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:01:30.690309+0000 0 0 2026-02-17T00:53:47.987 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:53:47.987 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:53:47.988 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:53:47.997 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-17T00:53:47.997 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 0 2026-02-17T00:53:47.997 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:53:47.998 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:53:47.999 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:53:48.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:53:48.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:53:48.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:53:48.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:53:48.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:53:48.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:53:48.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T00:53:48.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T00:53:48.000 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:53:48.001 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:53:48.001 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T00:53:48.002 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T00:53:48.002 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:53:48.002 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:53:48.002 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:53:48.016 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:48.012+0000 7fed0640d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:48.017 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:48.013+0000 7fed0640d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:48.018 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:48.014+0000 7fed0640d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:48.152 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:48.148+0000 7fed0640d780 -1 Falling back to public interface 2026-02-17T00:53:48.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T00:53:48.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:53:48.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:53:48.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:53:48.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:53:48.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:53:48.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:53:48.229 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:53:48.230 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:53:48.230 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:53:48.461 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:53:48.494 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:48.489+0000 7fed0640d780 -1 osd.0 28 log_to_monitors true 2026-02-17T00:53:49.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:53:49.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:53:49.463 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:53:49.464 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:53:49.464 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:53:49.464 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:53:49.693 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/65003463,v1:127.0.0.1:6801/65003463] [v2:127.0.0.1:6802/65003463,v1:127.0.0.1:6803/65003463] exists,up 44365f2e-8c44-4cf8-9dc2-0f1042f6586a 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 2 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:53:49.694 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T00:53:49.695 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:53:49.696 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:53:49.696 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T00:53:49.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T00:53:49.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:53:49.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:53:49.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:53:49.714 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:49.710+0000 7f1ec9e3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:49.716 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:49.711+0000 7f1ec9e3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:49.716 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:49.712+0000 7f1ec9e3d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:53:49.844 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:49.839+0000 7f1ec9e3d780 -1 Falling back to public interface 2026-02-17T00:53:49.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T00:53:49.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:53:49.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:53:49.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:53:49.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:53:49.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:53:49.936 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:53:49.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:53:49.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:53:49.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:53:50.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:53:50.180 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:53:50.176+0000 7f1ec9e3d780 -1 osd.2 28 log_to_monitors true 2026-02-17T00:53:51.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:53:51.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:53:51.169 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:53:51.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:53:51.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:53:51.170 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:53:51.400 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 31 last_clean_interval [13,28) [v2:127.0.0.1:6810/1571663564,v1:127.0.0.1:6811/1571663564] [v2:127.0.0.1:6812/1571663564,v1:127.0.0.1:6813/1571663564] exists,up a0cd068a-c54e-4e63-b6cd-541c4749bcdb 2026-02-17T00:53:51.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:53:51.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:53:51.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:53:51.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-17T00:53:51.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.0 2026-02-17T00:53:51.687 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already in. 2026-02-17T00:53:51.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-17T00:53:51.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.2 2026-02-17T00:53:51.991 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already in. 2026-02-17T00:53:52.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T00:53:52.001 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: wait_for_clean 2026-02-17T00:53:52.001 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:53:52.001 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:53:52.001 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:53:52.001 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T00:53:52.002 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:53:52.002 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:53:52.002 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:53:52.002 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:53:52.002 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:53:52.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T00:53:52.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:53:52.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:53:52.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:53:52.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:53:52.054 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:53:52.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:53:52.292 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:53:52.292 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:53:52.292 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:53:52.292 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:52.292 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:53:52.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-17T00:53:52.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-17T00:53:52.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363' 2026-02-17T00:53:52.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:52.361 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:53:52.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T00:53:52.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T00:53:52.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T00:53:52.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T00:53:52.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:53:52.412 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:53:52.481 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-17T00:53:52.481 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-17T00:53:52.481 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855363 2-163208757251' 2026-02-17T00:53:52.481 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:53:52.481 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855363 2026-02-17T00:53:52.481 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:53:52.482 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:53:52.483 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-17T00:53:52.483 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:53:52.484 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855363 2026-02-17T00:53:52.484 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-17T00:53:52.484 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 150323855363 2026-02-17T00:53:52.484 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:53:52.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 150323855363 2026-02-17T00:53:52.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:53:53.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:53:53.715 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:53:53.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-17T00:53:53.946 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:53:53.946 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757251 2026-02-17T00:53:53.946 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:53:53.947 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:53:53.947 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757251 2026-02-17T00:53:53.948 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:53:53.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-17T00:53:53.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-17T00:53:53.949 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 163208757251 2026-02-17T00:53:53.949 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:53:54.177 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-17T00:53:54.178 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:53:54.178 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:53:54.178 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:53:54.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:53:54.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:53:54.498 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:53:54.499 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:53:54.499 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:53:54.499 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:53:54.499 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:53:54.499 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:53:54.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:53:54.725 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:53:54.726 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:53:54.726 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:53:55.064 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:53:55.064 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T00:53:55.064 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T00:53:55.064 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T00:53:55.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:53:55.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T00:53:55.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:53:55.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:53:55.166 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:53:55.166 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:53:55.166 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:53:55.166 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:53:55.166 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:53:55.166 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:53:55.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:53:55.393 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:53:55.394 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:53:55.394 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:53:55.718 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:53:55.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:53:55.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:53:55.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:53:55.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:53:55.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:53:55.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:53:55.719 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:53:55.719 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:53:56.055 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:53:56.055 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:53:56.055 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T00:53:56.055 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:53:56.056 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T00:53:56.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:53:56.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:53:56.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:53:56.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:53:56.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:53:56.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:53:56.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:53:56.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:53:56.482 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:53:56.483 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:53:56.483 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:53:56.484 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:53:56.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:53:56.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:53:56.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:53:56.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:53:56.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:53:56.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:53:56.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:53:56.802 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:53:56.803 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:53:57.121 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:53:57.121 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:53:57.121 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T00:53:57.121 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:53:57.121 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T00:53:57.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:53:57.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:53:57.523 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:53:57.524 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:53:57.524 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:53:57.524 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:53:57.524 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:53:57.524 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:53:57.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:53:57.749 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:53:57.750 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:53:57.750 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:53:58.068 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:53:58.068 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:53:58.068 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:53:58.068 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:53:58.068 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:53:58.068 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:53:58.068 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:53:58.069 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:53:58.069 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:53:58.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:53:58.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:53:58.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T00:53:58.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:53:58.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T00:53:59.198 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:53:59.198 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:53:59.199 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:53:59.199 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:53:59.199 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:53:59.199 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:53:59.199 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:53:59.199 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:53:59.429 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:53:59.430 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:53:59.430 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:53:59.430 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:53:59.766 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:53:59.766 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:53:59.766 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:53:59.766 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:53:59.766 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:53:59.766 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:53:59.766 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:53:59.767 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:53:59.767 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:00.088 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:00.088 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:00.088 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T00:54:00.088 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:00.088 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T00:54:01.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:01.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:01.690 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:01.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:01.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:01.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:01.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:01.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:01.919 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:01.920 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:01.920 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:01.920 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:02.237 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:54:02.238 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:02.238 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:02.238 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:02.238 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:02.238 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:02.238 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:02.238 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:02.238 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:02.553 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:02.554 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:02.554 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T00:54:02.554 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:02.554 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T00:54:05.754 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:05.754 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:05.755 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:05.755 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:05.755 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:05.755 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:05.756 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:05.756 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:05.989 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:05.990 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:05.990 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:05.990 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:06.314 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:54:06.315 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:06.315 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:06.315 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:06.315 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:06.315 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:06.315 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:06.315 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:06.315 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:06.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:06.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:06.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T00:54:06.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:06.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T00:54:13.036 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:13.037 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:13.038 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:13.038 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:13.038 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:13.038 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:13.038 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:13.038 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:13.266 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:13.266 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:13.267 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:13.267 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:13.606 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:54:13.606 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:13.606 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:13.606 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:13.606 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:13.606 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:13.606 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:13.606 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:13.607 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:13.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:13.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:13.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T00:54:13.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:13.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T00:54:21.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:21.226 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:21.227 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:21.227 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:21.227 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:21.227 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:21.227 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:21.227 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:21.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:21.464 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:21.464 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:21.464 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:21.794 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T00:54:21.794 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:21.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:21.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:21.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:21.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:21.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:21.795 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:21.795 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:22.118 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:22.119 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:22.119 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T00:54:22.119 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T00:54:22.430 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:54:22.430 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_fingerprint": "78fb2ed5-e840-4ce3-b449-39caf2bec507", 2026-02-17T00:54:22.430 INFO:tasks.workunit.client.0.trial092.stdout: "version": "20.3.0-5225-g03ef619e", 2026-02-17T00:54:22.430 INFO:tasks.workunit.client.0.trial092.stdout: "commit": "03ef619e79a56cd363b087a5c6f19a1a09b49040", 2026-02-17T00:54:22.430 INFO:tasks.workunit.client.0.trial092.stdout: "timestamp": "2026-02-17T00:54:22.426754+0000", 2026-02-17T00:54:22.430 INFO:tasks.workunit.client.0.trial092.stdout: "tag": "", 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: "health": { 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: "status": "HEALTH_WARN", 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: "checks": { 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: "OSDMAP_FLAGS": { 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: "count": 17 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [], 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:54:22.431 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: "OSD_DOWN": { 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: "message": "1 osds down", 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: "count": 1 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: "message": "osd.1 (root=default,host=trial092) is down" 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:54:22.432 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: "PG_DEGRADED": { 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: "count": 32 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.0 is active+undersized+degraded+wait, acting [0,2]" 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.433 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.434 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.435 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.436 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.437 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.438 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.439 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.440 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: "mutes": [] 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_first_committed": 1, 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_last_committed": 1, 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: "monmap": { 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:53:10.909343Z", 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:53:10.909343Z", 2026-02-17T00:54:22.441 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release": 20, 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release_name": "tentacle", 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "election_strategy": 1, 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "disallowed_leaders": "", 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": false, 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "tiebreaker_mon": "", 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "removed_ranks": "", 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "features": { 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "persistent": [ 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "kraken", 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "luminous", 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "mimic", 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap-prune", 2026-02-17T00:54:22.442 INFO:tasks.workunit.client.0.trial092.stdout: "nautilus", 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: "octopus", 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: "pacific", 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: "elector-pinging", 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: "quincy", 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: "reef", 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: "squid", 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: "tentacle", 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: "nvmeof_beacon_diff" 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: "optional": [] 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: "mons": [ 2026-02-17T00:54:22.443 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: "rank": 0, 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: "name": "a", 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115", 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 0 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.444 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: "priority": 0, 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 0, 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: "time_added": "2026-02-17T00:53:10:909339+0000", 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: "crush_location": [] 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: "quorum": [ 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: 0 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.445 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap": { 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 47, 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:53:10.945063+0000", 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:54:15.330710+0000", 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "last_up_change": "2026-02-17T00:53:50.312034+0000", 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "last_in_change": "2026-02-17T00:53:51.920655+0000", 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "flags_num": 5800384, 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "flags_set": [ 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "nodown", 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "noin", 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "noout", 2026-02-17T00:54:22.446 INFO:tasks.workunit.client.0.trial092.stdout: "pglog_hardlimit", 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snapdirs", 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: "recovery_deletes", 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: "sortbitwise" 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: "crush_version": 9, 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_snapshot": "", 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: "pool_max": 1, 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: "max_osd": 3, 2026-02-17T00:54:22.447 INFO:tasks.workunit.client.0.trial092.stdout: "require_min_compat_client": "luminous", 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: "min_compat_client": "jewel", 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: "require_osd_release": "tentacle", 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: "allow_crimson": false, 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: "pools": [ 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: "pool_name": "test", 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: "create_time": "2026-02-17T00:53:20.789012+0000", 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: "flags": 1, 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: "flags_names": "hashpspool", 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:54:22.448 INFO:tasks.workunit.client.0.trial092.stdout: "size": 3, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "min_size": 2, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "crush_rule": 0, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_count": 0, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_target": 0, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "is_stretch_pool": false, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "object_hash": 2, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "pg_autoscale_mode": "on", 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num": 32, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num": 1, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num_target": 32, 2026-02-17T00:54:22.449 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_target": 32, 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_pending": 32, 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "last_pg_merge_meta": { 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "source_pgid": "0.0", 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "ready_epoch": 0, 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_started": 0, 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": 0, 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "source_version": "0'0", 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "target_version": "0'0" 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "last_change": "46", 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend": "0", 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T00:54:22.450 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_preluminous": "46", 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "auid": 0, 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "snap_mode": "selfmanaged", 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "snap_seq": 0, 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "snap_epoch": 0, 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "pool_snaps": [], 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps": "[]", 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_bytes": 0, 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_objects": 0, 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "tiers": [], 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "tier_of": -1, 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "read_tier": -1, 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "write_tier": -1, 2026-02-17T00:54:22.451 INFO:tasks.workunit.client.0.trial092.stdout: "cache_mode": "none", 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_bytes": 0, 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_objects": 0, 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_flush_age": 0, 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_evict_age": 0, 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profile": "", 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_params": { 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "type": "none" 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_period": 0, 2026-02-17T00:54:22.452 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_count": 0, 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "use_gmt_hitset": true, 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "min_read_recency_for_promote": 0, 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "min_write_recency_for_promote": 0, 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_search_last_n": 0, 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "grade_table": [], 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "stripe_width": 0, 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "expected_num_objects": 0, 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "fast_read": false, 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "nonprimary_shards": "{}", 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "options": {}, 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "application_metadata": {}, 2026-02-17T00:54:22.453 INFO:tasks.workunit.client.0.trial092.stdout: "read_balance": { 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: "score_type": "Fair distribution", 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: "score_acting": 2.9900000095367432, 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: "score_stable": 2.9900000095367432, 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: "raw_score_acting": 2, 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: "raw_score_stable": 2, 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity_weighted": 1, 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: "average_primary_affinity": 1, 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: "average_primary_affinity_weighted": 1 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.454 INFO:tasks.workunit.client.0.trial092.stdout: "osds": [ 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "44365f2e-8c44-4cf8-9dc2-0f1042f6586a", 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 5, 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 28, 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 35, 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 46, 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 29, 2026-02-17T00:54:22.455 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6800", 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6801", 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.456 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6802", 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6803", 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.457 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6806", 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6807", 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:22.458 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6804", 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6805", 2026-02-17T00:54:22.459 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6801/65003463", 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6803/65003463", 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6807/65003463", 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6805/65003463", 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.460 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "88cb08c5-e268-4844-904f-02be0aa73443", 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "up": 0, 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 0, 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 0, 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 9, 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 20, 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 30, 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:54:22.461 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.462 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.463 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:22.464 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:22.465 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/306387533", 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/306387533", 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/306387533", 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/306387533", 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: "exists" 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "a0cd068a-c54e-4e63-b6cd-541c4749bcdb", 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:54:22.466 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 13, 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 28, 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 38, 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 0, 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 31, 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:22.467 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:22.468 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.469 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:22.470 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/1571663564", 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/1571663564", 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1571663564", 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1571663564", 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: "osd_xinfo": [ 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.471 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:53:46.535373+0000", 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:53:13.664658+0000", 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:53:46.825255+0000", 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:54:22.472 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:53:47.113275+0000", 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:53:19.446871+0000", 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap": [], 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_items": [], 2026-02-17T00:54:22.473 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_primaries": [], 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "pg_temp": [], 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "primary_temp": [], 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "blocklist": {}, 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "range_blocklist": {}, 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profiles": { 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "default": { 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "k": "2", 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "m": "2", 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "plugin": "isa", 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "technique": "reed_sol_van" 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps_queue": [], 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "new_removed_snaps": [], 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "new_purged_snaps": [], 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "crush_node_flags": {}, 2026-02-17T00:54:22.474 INFO:tasks.workunit.client.0.trial092.stdout: "device_class_flags": {}, 2026-02-17T00:54:22.475 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": { 2026-02-17T00:54:22.475 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_enabled": false, 2026-02-17T00:54:22.475 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_bucket_count": 0, 2026-02-17T00:54:22.475 INFO:tasks.workunit.client.0.trial092.stdout: "degraded_stretch_mode": 0, 2026-02-17T00:54:22.475 INFO:tasks.workunit.client.0.trial092.stdout: "recovering_stretch_mode": 0, 2026-02-17T00:54:22.475 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_bucket": 0 2026-02-17T00:54:22.475 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.475 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.475 INFO:tasks.workunit.client.0.trial092.stdout: "osd_metadata": [ 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6802/65003463,v1:127.0.0.1:6803/65003463]", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:54:22.476 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:53:11.672268Z", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:54:22.477 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6800/65003463,v1:127.0.0.1:6801/65003463]", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/65003463,v1:127.0.0.1:6807/65003463]", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/65003463,v1:127.0.0.1:6805/65003463]", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:54:22.478 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/306387533,v1:127.0.0.1:6813/306387533]", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:54:22.479 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:53:14.992194Z", 2026-02-17T00:54:22.480 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/306387533,v1:127.0.0.1:6811/306387533]", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/306387533,v1:127.0.0.1:6817/306387533]", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/306387533,v1:127.0.0.1:6815/306387533]", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T00:54:22.481 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/1571663564,v1:127.0.0.1:6813/1571663564]", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T00:54:22.482 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:53:17.629902Z", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/1571663564,v1:127.0.0.1:6811/1571663564]", 2026-02-17T00:54:22.483 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1571663564,v1:127.0.0.1:6817/1571663564]", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1571663564,v1:127.0.0.1:6815/1571663564]", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_clean_epochs": { 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "min_last_epoch_clean": 0, 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": { 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: "per_pool": [] 2026-02-17T00:54:22.484 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "osd_epochs": [ 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 35 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 38 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_first_committed": 1, 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_last_committed": 47, 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "crushmap": { 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "devices": [ 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.0", 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:54:22.485 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.1", 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.2", 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "types": [ 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 0, 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd" 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "name": "host" 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 2, 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "name": "chassis" 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.486 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 3, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "name": "rack" 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 4, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "name": "row" 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 5, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pdu" 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 6, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pod" 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 7, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "name": "room" 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 8, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "name": "datacenter" 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.487 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 9, 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stdout: "name": "zone" 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stderr:report 387699533 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 10, 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stdout: "name": "region" 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stdout: "name": "root" 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.488 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "buckets": [ 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "id": -1, 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default", 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "id": -2, 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default~ssd", 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:54:22.489 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092", 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.490 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092~ssd", 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.491 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "rules": [ 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "rule_id": 0, 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "rule_name": "replicated_rule", 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "steps": [ 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "op": "take", 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "item": -1, 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "item_name": "default" 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "op": "choose_firstn", 2026-02-17T00:54:22.492 INFO:tasks.workunit.client.0.trial092.stdout: "num": 0, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "type": "osd" 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "op": "emit" 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "tunables": { 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_tries": 0, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_fallback_tries": 0, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "choose_total_tries": 50, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_descend_once": 1, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_vary_r": 1, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_stable": 1, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "msr_descents": 100, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "msr_collision_tries": 100, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "straw_calc_version": 1, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "allowed_bucket_algs": 54, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "profile": "jewel", 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_tunables": 1, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "legacy_tunables": 0, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "minimum_required_version": "jewel", 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables": 1, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables2": 1, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "has_v2_rules": 0, 2026-02-17T00:54:22.493 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables3": 1, 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "has_v3_rules": 0, 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "has_v4_buckets": 1, 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables5": 1, 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "has_v5_rules": 0, 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "has_msr_rules": 0 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "choose_args": {} 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "fsmap": { 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "btime": "2026-02-17T00:53:10:944921+0000", 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "default_fscid": -1, 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "compat": { 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "compat": {}, 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "ro_compat": {}, 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "incompat": { 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "feature_1": "base v0.20", 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "feature_2": "client writeable ranges", 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "feature_4": "dir inode in separate object", 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "feature_8": "no anchor table", 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "feature_9": "file layout v2", 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "feature_10": "snaprealm v2", 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "feature_11": "minor log segments", 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T00:54:22.494 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "feature_flags": { 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "enable_multiple": true, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "ever_enabled_multiple": true 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "standbys": [], 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "filesystems": [] 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_first_committed": 1, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_last_committed": 1, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "auth": { 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 5, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "num_secrets": 3 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 32, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_active": 32, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_unknown": 0, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "num_osd": 3, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "pool_sum": { 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 51200, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 100, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 0, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 300, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:54:22.495 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 100, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 100, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 100, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 100, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:54:22.496 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 512, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 512, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "up": 64, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 64, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 0 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum": { 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:54:22.497 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 65, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83976, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2192, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 31, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81696, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488824, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036555776, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2244608, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 468076, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 31920, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83657552 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:54:22.498 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum_by_class": { 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "ssd": { 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 65, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83976, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2192, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 31, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81696, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488824, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036555776, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2244608, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 468076, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:54:22.499 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 31920, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83657552 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "pool_stats": [ 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": 1, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 32, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 51200, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 100, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 0, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 300, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:54:22.500 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 100, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 100, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 100, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 100, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:54:22.501 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 1220608, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 153552, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 512, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 512, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "up": 64, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 64, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 3 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "osd_stats": [ 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 150323855369 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 38654705676 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:54:22.502 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 163208757257 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_state": [ 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "state": "active+undersized+degraded", 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "num": 31 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "state": "active+undersized+degraded+wait", 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "num": 1 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "pool_pg_unavailable_map": [ 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": "1", 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "pgs": [] 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_osd": [ 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 32, 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 32, 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 32, 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:54:22.503 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 0, 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": [ 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": {} 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "servicemap": { 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 3, 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:54:17.179161+0000", 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "services": { 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "osd": { 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "daemons": { 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "summary": "", 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "0": { 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "start_epoch": 0, 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "start_stamp": "0.000000", 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "gid": 0, 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "metadata": {}, 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "task_status": {} 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "2": { 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "start_epoch": 0, 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "start_stamp": "0.000000", 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "gid": 0, 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "metadata": {}, 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: "task_status": {} 2026-02-17T00:54:22.504 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_first_committed": 1, 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_last_committed": 36, 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: "logm_first_committed": 1, 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: "logm_last_committed": 221, 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: "paxos": { 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 315, 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: "last_pn": 0, 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: "accepted_pn": 0 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: expr 2 + 2 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: objname=existing_4 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2026-02-17T00:54:22.505 INFO:tasks.workunit.client.0.trial092.stdout:writing non-divergent object existing_4 2026-02-17T00:54:22.506 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:757: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340621+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340980+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340882+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340969+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341103+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341324+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340869+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342186+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342336+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342166+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342129+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341920+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342023+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342123+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340730+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340375+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.659 INFO:tasks.workunit.client.0.trial092.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded+wait 2026-02-17T00:54:15.338000+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342178+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342077+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342214+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340268+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339955+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340363+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340045+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:18.474664+0000 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340485+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340778+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340441+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340698+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340585+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339942+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340213+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340192+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:54:22.660 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:54:22.666 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.T13Jc6reTs 2026-02-17T00:54:22.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T00:54:22.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: wait_for_clean 2026-02-17T00:54:22.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:54:22.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:54:22.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:54:22.686 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T00:54:22.687 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:54:22.687 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:54:22.687 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:54:22.687 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:54:22.687 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:54:22.739 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T00:54:22.739 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:54:22.739 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:54:22.739 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:54:22.740 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:54:22.740 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:54:22.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:54:22.969 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:54:22.969 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:54:22.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:54:22.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:54:22.969 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:54:23.039 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-17T00:54:23.039 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-17T00:54:23.039 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371' 2026-02-17T00:54:23.039 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:54:23.039 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:54:23.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T00:54:23.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T00:54:23.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T00:54:23.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T00:54:23.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:54:23.090 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:54:23.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757259 2026-02-17T00:54:23.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757259 2026-02-17T00:54:23.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-150323855371 2-163208757259' 2026-02-17T00:54:23.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:54:23.158 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-150323855371 2026-02-17T00:54:23.159 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:54:23.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:54:23.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855371 2026-02-17T00:54:23.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:54:23.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=150323855371 2026-02-17T00:54:23.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 150323855371' 2026-02-17T00:54:23.161 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 150323855371 2026-02-17T00:54:23.161 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:54:23.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 150323855371 -lt 150323855371 2026-02-17T00:54:23.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:54:23.394 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-163208757259 2026-02-17T00:54:23.394 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:54:23.394 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:54:23.395 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757259 2026-02-17T00:54:23.395 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:54:23.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757259 2026-02-17T00:54:23.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 163208757259' 2026-02-17T00:54:23.397 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 163208757259 2026-02-17T00:54:23.397 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:54:23.623 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757259 -lt 163208757259 2026-02-17T00:54:23.624 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:54:23.625 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:23.625 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:23.961 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-17T00:54:23.961 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:23.961 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:23.961 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:23.961 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:23.962 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:23.962 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:23.962 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:24.189 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:24.189 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:24.189 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:24.190 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:24.516 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T00:54:24.516 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T00:54:24.516 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T00:54:24.516 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T00:54:24.516 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:24.516 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T00:54:24.617 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:24.617 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:24.618 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:24.618 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:24.618 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:24.618 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:24.619 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:24.619 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:24.847 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:24.848 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:24.848 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:24.849 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:25.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T00:54:25.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:25.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:25.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:25.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:25.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:25.174 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:25.174 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:25.174 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:25.509 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:25.509 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:25.509 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T00:54:25.509 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:25.509 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T00:54:25.709 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:25.710 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:25.711 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:25.711 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:25.711 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:25.711 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:25.711 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:25.711 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:25.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:25.940 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:25.940 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:25.940 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:26.260 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T00:54:26.260 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:26.260 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:26.260 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:26.260 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:26.261 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:26.261 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:26.261 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:26.261 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:26.583 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:26.583 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:26.583 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T00:54:26.583 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:26.583 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T00:54:26.984 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:26.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:26.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:26.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:26.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:26.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:26.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:26.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:27.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:27.215 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:27.215 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:27.215 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:27.540 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T00:54:27.540 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:27.541 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:27.541 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:27.541 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:27.541 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:27.541 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:27.541 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:27.541 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:27.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:27.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:27.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T00:54:27.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:27.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T00:54:28.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:28.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:28.662 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:28.662 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:28.662 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:28.662 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:28.662 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:28.662 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:28.894 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:28.895 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:28.896 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:28.896 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:29.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T00:54:29.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:29.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:29.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:29.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:29.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:29.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:29.215 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:29.215 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:29.539 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:29.539 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:29.539 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T00:54:29.539 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:29.539 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T00:54:31.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:31.140 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:31.141 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:31.141 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:31.141 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:31.141 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:31.141 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:31.141 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:31.372 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:31.372 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:31.372 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:31.373 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:31.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T00:54:31.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:31.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:31.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:31.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:31.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:31.690 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:31.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:31.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:32.014 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:32.014 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:32.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T00:54:32.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:32.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T00:54:35.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:35.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:35.216 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:35.216 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:35.216 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:35.216 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:35.217 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:35.217 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:35.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:35.449 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:35.450 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:35.450 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:35.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T00:54:35.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:35.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:35.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:35.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:35.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:35.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:35.771 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:35.771 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:36.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:36.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:36.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T00:54:36.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:36.094 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T00:54:42.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:42.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:42.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:42.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:42.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:42.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:42.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:42.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:42.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:42.725 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:42.725 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:42.726 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:43.044 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T00:54:43.044 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:43.044 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:43.045 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:43.045 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:43.045 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:43.045 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:43.045 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:43.045 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:43.371 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:43.371 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:43.371 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T00:54:43.371 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:54:43.371 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T00:54:50.672 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:54:50.672 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:54:50.673 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:54:50.673 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:54:50.673 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:54:50.674 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:54:50.674 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:54:50.674 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:54:50.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:54:50.900 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:54:50.901 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:54:50.901 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:54:51.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-17T00:54:51.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:54:51.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:54:51.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:54:51.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:54:51.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:54:51.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:54:51.226 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:54:51.226 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:54:51.541 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:54:51.541 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:54:51.541 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T00:54:51.541 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T00:54:51.854 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:54:51.854 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_fingerprint": "78fb2ed5-e840-4ce3-b449-39caf2bec507", 2026-02-17T00:54:51.854 INFO:tasks.workunit.client.0.trial092.stdout: "version": "20.3.0-5225-g03ef619e", 2026-02-17T00:54:51.854 INFO:tasks.workunit.client.0.trial092.stdout: "commit": "03ef619e79a56cd363b087a5c6f19a1a09b49040", 2026-02-17T00:54:51.854 INFO:tasks.workunit.client.0.trial092.stdout: "timestamp": "2026-02-17T00:54:51.851549+0000", 2026-02-17T00:54:51.854 INFO:tasks.workunit.client.0.trial092.stdout: "tag": "", 2026-02-17T00:54:51.854 INFO:tasks.workunit.client.0.trial092.stdout: "health": { 2026-02-17T00:54:51.854 INFO:tasks.workunit.client.0.trial092.stdout: "status": "HEALTH_WARN", 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "checks": { 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "OSDMAP_FLAGS": { 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "count": 17 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [], 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "OSD_DOWN": { 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "message": "1 osds down", 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "count": 1 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "message": "osd.1 (root=default,host=trial092) is down" 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "PG_DEGRADED": { 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "count": 32 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:54:51.855 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.856 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.857 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.858 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "mutes": [] 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_first_committed": 1, 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_last_committed": 1, 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "monmap": { 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:53:10.909343Z", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:53:10.909343Z", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release": 20, 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release_name": "tentacle", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "election_strategy": 1, 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "disallowed_leaders": "", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": false, 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "tiebreaker_mon": "", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "removed_ranks": "", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "features": { 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "persistent": [ 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "kraken", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "luminous", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "mimic", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap-prune", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "nautilus", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "octopus", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "pacific", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "elector-pinging", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "quincy", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "reef", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "squid", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "tentacle", 2026-02-17T00:54:51.859 INFO:tasks.workunit.client.0.trial092.stdout: "nvmeof_beacon_diff" 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "optional": [] 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "mons": [ 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "rank": 0, 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "name": "a", 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115", 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 0 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "priority": 0, 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 0, 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "time_added": "2026-02-17T00:53:10:909339+0000", 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "crush_location": [] 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "quorum": [ 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: 0 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap": { 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 47, 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:53:10.945063+0000", 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:54:15.330710+0000", 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "last_up_change": "2026-02-17T00:53:50.312034+0000", 2026-02-17T00:54:51.860 INFO:tasks.workunit.client.0.trial092.stdout: "last_in_change": "2026-02-17T00:53:51.920655+0000", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "flags_num": 5800384, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "flags_set": [ 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "nodown", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "noin", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "noout", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "pglog_hardlimit", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snapdirs", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "recovery_deletes", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "sortbitwise" 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "crush_version": 9, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_snapshot": "", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "pool_max": 1, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "max_osd": 3, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "require_min_compat_client": "luminous", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "min_compat_client": "jewel", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "require_osd_release": "tentacle", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "allow_crimson": false, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "pools": [ 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "pool_name": "test", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "create_time": "2026-02-17T00:53:20.789012+0000", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "flags": 1, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "flags_names": "hashpspool", 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "size": 3, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "min_size": 2, 2026-02-17T00:54:51.861 INFO:tasks.workunit.client.0.trial092.stdout: "crush_rule": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_count": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_target": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "is_stretch_pool": false, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "object_hash": 2, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "pg_autoscale_mode": "on", 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num": 32, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num": 1, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num_target": 32, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_target": 32, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_pending": 32, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "last_pg_merge_meta": { 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "source_pgid": "0.0", 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "ready_epoch": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_started": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "source_version": "0'0", 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "target_version": "0'0" 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "last_change": "46", 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend": "0", 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_preluminous": "46", 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "auid": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "snap_mode": "selfmanaged", 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "snap_seq": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "snap_epoch": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "pool_snaps": [], 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps": "[]", 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_bytes": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_objects": 0, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "tiers": [], 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "tier_of": -1, 2026-02-17T00:54:51.862 INFO:tasks.workunit.client.0.trial092.stdout: "read_tier": -1, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "write_tier": -1, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "cache_mode": "none", 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_bytes": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_objects": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_flush_age": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_evict_age": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profile": "", 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_params": { 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "type": "none" 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_period": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_count": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "use_gmt_hitset": true, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "min_read_recency_for_promote": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "min_write_recency_for_promote": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_search_last_n": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "grade_table": [], 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "stripe_width": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "expected_num_objects": 0, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "fast_read": false, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "nonprimary_shards": "{}", 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "options": {}, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "application_metadata": {}, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "read_balance": { 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "score_type": "Fair distribution", 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "score_acting": 2.9900000095367432, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "score_stable": 2.9900000095367432, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "raw_score_acting": 2, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "raw_score_stable": 2, 2026-02-17T00:54:51.863 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity_weighted": 1, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "average_primary_affinity": 1, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "average_primary_affinity_weighted": 1 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "osds": [ 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "44365f2e-8c44-4cf8-9dc2-0f1042f6586a", 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 5, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 28, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 35, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 46, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 29, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6800", 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6801", 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:51.864 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6802", 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6803", 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6806", 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6807", 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.865 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6804", 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6805", 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 65003463 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6801/65003463", 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6803/65003463", 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6807/65003463", 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6805/65003463", 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "88cb08c5-e268-4844-904f-02be0aa73443", 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "up": 0, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 0, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 0, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 9, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 20, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 30, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:54:51.866 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:51.867 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 306387533 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/306387533", 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/306387533", 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/306387533", 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/306387533", 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "exists" 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "a0cd068a-c54e-4e63-b6cd-541c4749bcdb", 2026-02-17T00:54:51.868 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 13, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 28, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 38, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 0, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 31, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:51.869 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1571663564 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/1571663564", 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/1571663564", 2026-02-17T00:54:51.870 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1571663564", 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1571663564", 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "osd_xinfo": [ 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:53:46.535373+0000", 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:53:13.664658+0000", 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:53:46.825255+0000", 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:53:47.113275+0000", 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:54:51.871 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:53:19.446871+0000", 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap": [], 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_items": [], 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_primaries": [], 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "pg_temp": [], 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "primary_temp": [], 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "blocklist": {}, 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "range_blocklist": {}, 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profiles": { 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "default": { 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "k": "2", 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "m": "2", 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "plugin": "isa", 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "technique": "reed_sol_van" 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps_queue": [], 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "new_removed_snaps": [], 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "new_purged_snaps": [], 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "crush_node_flags": {}, 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "device_class_flags": {}, 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": { 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_enabled": false, 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_bucket_count": 0, 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "degraded_stretch_mode": 0, 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "recovering_stretch_mode": 0, 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_bucket": 0 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "osd_metadata": [ 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.872 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6802/65003463,v1:127.0.0.1:6803/65003463]", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:53:11.672268Z", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:54:51.873 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6800/65003463,v1:127.0.0.1:6801/65003463]", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/65003463,v1:127.0.0.1:6807/65003463]", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/65003463,v1:127.0.0.1:6805/65003463]", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/306387533,v1:127.0.0.1:6813/306387533]", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:54:51.874 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:53:14.992194Z", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/306387533,v1:127.0.0.1:6811/306387533]", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/306387533,v1:127.0.0.1:6817/306387533]", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/306387533,v1:127.0.0.1:6815/306387533]", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:54:51.875 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/1571663564,v1:127.0.0.1:6813/1571663564]", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:54:51.876 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:53:17.629902Z", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/1571663564,v1:127.0.0.1:6811/1571663564]", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1571663564,v1:127.0.0.1:6817/1571663564]", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1571663564,v1:127.0.0.1:6815/1571663564]", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_clean_epochs": { 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "min_last_epoch_clean": 0, 2026-02-17T00:54:51.877 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": { 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "per_pool": [] 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "osd_epochs": [ 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 35 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 38 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_first_committed": 1, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_last_committed": 47, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "crushmap": { 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "devices": [ 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.0", 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.1", 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.2", 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: "types": [ 2026-02-17T00:54:51.878 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 0, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd" 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "name": "host" 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 2, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "name": "chassis" 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 3, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "name": "rack" 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 4, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "name": "row" 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 5, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pdu" 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 6, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pod" 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 7, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "name": "room" 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 8, 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: "name": "datacenter" 2026-02-17T00:54:51.879 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 9, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "name": "zone" 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 10, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "name": "region" 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "name": "root" 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "buckets": [ 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "id": -1, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default", 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "id": -2, 2026-02-17T00:54:51.880 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default~ssd", 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092", 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:54:51.881 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092~ssd", 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "rules": [ 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.882 INFO:tasks.workunit.client.0.trial092.stdout: "rule_id": 0, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "rule_name": "replicated_rule", 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "steps": [ 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "op": "take", 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "item": -1, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "item_name": "default" 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "op": "choose_firstn", 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "num": 0, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "type": "osd" 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "op": "emit" 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "tunables": { 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_tries": 0, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_fallback_tries": 0, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "choose_total_tries": 50, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_descend_once": 1, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_vary_r": 1, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_stable": 1, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "msr_descents": 100, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "msr_collision_tries": 100, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "straw_calc_version": 1, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "allowed_bucket_algs": 54, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "profile": "jewel", 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_tunables": 1, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "legacy_tunables": 0, 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "minimum_required_version": "jewel", 2026-02-17T00:54:51.883 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables": 1, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables2": 1, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "has_v2_rules": 0, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables3": 1, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "has_v3_rules": 0, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "has_v4_buckets": 1, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables5": 1, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "has_v5_rules": 0, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "has_msr_rules": 0 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "choose_args": {} 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "fsmap": { 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "btime": "2026-02-17T00:53:10:944921+0000", 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "default_fscid": -1, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "compat": { 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "compat": {}, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "ro_compat": {}, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "incompat": { 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_1": "base v0.20", 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_2": "client writeable ranges", 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_4": "dir inode in separate object", 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_8": "no anchor table", 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_9": "file layout v2", 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_10": "snaprealm v2", 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_11": "minor log segments", 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "feature_flags": { 2026-02-17T00:54:51.884 INFO:tasks.workunit.client.0.trial092.stdout: "enable_multiple": true, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "ever_enabled_multiple": true 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "standbys": [], 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "filesystems": [] 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_first_committed": 1, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_last_committed": 1, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "auth": { 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 5, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_secrets": 3 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 32, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_active": 32, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_unknown": 0, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_osd": 3, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "pool_sum": { 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 51688, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 100, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 0, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 300, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 100, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 100, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 101, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 101, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:54:51.885 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 513, 2026-02-17T00:54:51.886 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 513, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "up": 64, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 64, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 0 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum": { 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 65, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83976, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2192, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 31, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81696, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488824, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036555776, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2244608, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 469052, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 31920, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83657552 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:54:51.887 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum_by_class": { 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "ssd": { 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 65, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83976, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2192, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 31, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81696, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488824, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036555776, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2244608, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 469052, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 31920, 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83657552 2026-02-17T00:54:51.888 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "pool_stats": [ 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": 1, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 32, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 51688, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 100, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 300, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 100, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 100, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 101, 2026-02-17T00:54:51.889 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 101, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 1220608, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 154528, 2026-02-17T00:54:51.890 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 513, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 513, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "up": 64, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 64, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 3 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "osd_stats": [ 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 150323855377 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 38654705676 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 163208757265 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_state": [ 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "state": "active+undersized+degraded", 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "num": 32 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "pool_pg_unavailable_map": [ 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": "1", 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "pgs": [] 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.891 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_osd": [ 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 32, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 32, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 32, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 0, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": [ 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": {} 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "servicemap": { 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 5, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:54:51.184231+0000", 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "services": {} 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_first_committed": 1, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_last_committed": 51, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "logm_first_committed": 1, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "logm_last_committed": 281, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "paxos": { 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 390, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "last_pn": 0, 2026-02-17T00:54:51.892 INFO:tasks.workunit.client.0.trial092.stdout: "accepted_pn": 0 2026-02-17T00:54:51.893 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:54:51.893 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:54:51.893 INFO:tasks.workunit.client.0.trial092.stderr:report 796144817 2026-02-17T00:54:51.893 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T00:54:51.893 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: echo 'delay recovery' 2026-02-17T00:54:51.893 INFO:tasks.workunit.client.0.trial092.stdout:delay recovery 2026-02-17T00:54:51.893 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:764: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:54:52.081 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:54:52.081 INFO:tasks.workunit.client.0.trial092.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340621+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.081 INFO:tasks.workunit.client.0.trial092.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340980+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.081 INFO:tasks.workunit.client.0.trial092.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340882+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.081 INFO:tasks.workunit.client.0.trial092.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340969+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.081 INFO:tasks.workunit.client.0.trial092.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341103+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.081 INFO:tasks.workunit.client.0.trial092.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341324+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.081 INFO:tasks.workunit.client.0.trial092.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340869+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.081 INFO:tasks.workunit.client.0.trial092.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342186+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342336+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342166+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342129+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341920+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342023+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342123+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340730+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340375+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:24.024299+0000 28'100 47:159 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:15.482064+0000 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342178+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:54:15.342077+0000 47'101 47:159 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342214+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340268+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339955+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340363+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340045+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:18.474664+0000 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340485+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340778+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340441+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340698+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.082 INFO:tasks.workunit.client.0.trial092.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340585+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.083 INFO:tasks.workunit.client.0.trial092.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339942+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.083 INFO:tasks.workunit.client.0.trial092.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340213+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.083 INFO:tasks.workunit.client.0.trial092.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340192+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.083 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:54:52.083 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:54:52.083 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:54:52.088 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-17T00:54:52.089 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.0 2026-02-17T00:54:52.089 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T00:54:52.089 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T00:54:52.090 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:54:52.090 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:54:52.090 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:54:52.090 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.0.asok 2026-02-17T00:54:52.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-17T00:54:52.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T00:54:52.135 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:54:52.138 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-17T00:54:52.140 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.2 2026-02-17T00:54:52.140 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T00:54:52.140 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T00:54:52.140 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:54:52.140 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:54:52.140 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:54:52.141 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.2.asok 2026-02-17T00:54:52.141 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-17T00:54:52.141 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T00:54:52.185 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:54:52.189 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: echo 'revive divergent 1' 2026-02-17T00:54:52.190 INFO:tasks.workunit.client.0.trial092.stdout:revive divergent 1 2026-02-17T00:54:52.190 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:54:52.407 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:54:52.407 INFO:tasks.workunit.client.0.trial092.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340621+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.407 INFO:tasks.workunit.client.0.trial092.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340980+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.408 INFO:tasks.workunit.client.0.trial092.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340882+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.408 INFO:tasks.workunit.client.0.trial092.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340969+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.408 INFO:tasks.workunit.client.0.trial092.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341103+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.408 INFO:tasks.workunit.client.0.trial092.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341324+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.408 INFO:tasks.workunit.client.0.trial092.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340869+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.408 INFO:tasks.workunit.client.0.trial092.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342186+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.408 INFO:tasks.workunit.client.0.trial092.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342336+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.408 INFO:tasks.workunit.client.0.trial092.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342166+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.408 INFO:tasks.workunit.client.0.trial092.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342129+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.408 INFO:tasks.workunit.client.0.trial092.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341920+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.409 INFO:tasks.workunit.client.0.trial092.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342023+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.409 INFO:tasks.workunit.client.0.trial092.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342123+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.409 INFO:tasks.workunit.client.0.trial092.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340730+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.409 INFO:tasks.workunit.client.0.trial092.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340375+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.409 INFO:tasks.workunit.client.0.trial092.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:24.024299+0000 28'100 47:159 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:15.482064+0000 0 0 2026-02-17T00:54:52.409 INFO:tasks.workunit.client.0.trial092.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342178+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.409 INFO:tasks.workunit.client.0.trial092.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:54:15.342077+0000 47'101 47:159 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.409 INFO:tasks.workunit.client.0.trial092.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342214+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.409 INFO:tasks.workunit.client.0.trial092.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340268+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.409 INFO:tasks.workunit.client.0.trial092.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339955+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.409 INFO:tasks.workunit.client.0.trial092.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340363+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.410 INFO:tasks.workunit.client.0.trial092.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340045+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:18.474664+0000 0 0 2026-02-17T00:54:52.410 INFO:tasks.workunit.client.0.trial092.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340485+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.410 INFO:tasks.workunit.client.0.trial092.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340778+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.410 INFO:tasks.workunit.client.0.trial092.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340441+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.410 INFO:tasks.workunit.client.0.trial092.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340698+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.410 INFO:tasks.workunit.client.0.trial092.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340585+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.410 INFO:tasks.workunit.client.0.trial092.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339942+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.410 INFO:tasks.workunit.client.0.trial092.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340213+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.410 INFO:tasks.workunit.client.0.trial092.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340192+0000 28'100 47:158 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:52.410 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:54:52.411 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:54:52.411 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:54:52.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: ceph osd set noup 2026-02-17T00:54:52.734 INFO:tasks.workunit.client.0.trial092.stderr:noup is set 2026-02-17T00:54:52.748 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:774: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-17T00:54:52.748 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:54:52.748 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:54:52.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T00:54:52.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:54:52.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:54:52.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:54:52.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:54:52.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:54:52.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:54:52.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:54:52.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:54:52.749 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:54:52.750 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:54:52.750 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:54:52.750 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:54:52.750 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:54:52.750 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:54:52.750 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:54:52.750 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:54:52.750 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:54:52.750 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:54:52.750 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:54:52.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:54:52.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:54:52.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:54:52.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:54:52.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:54:52.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:54:52.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:54:52.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:54:52.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:54:52.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:54:52.752 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T00:54:52.752 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:54:52.753 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:54:52.753 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T00:54:52.753 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T00:54:52.753 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:54:52.753 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:54:52.753 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:54:52.766 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:54:52.762+0000 7f2860a1b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:54:52.767 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:54:52.763+0000 7f2860a1b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:54:52.768 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:54:52.764+0000 7f2860a1b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:54:52.921 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:54:52.917+0000 7f2860a1b780 -1 Falling back to public interface 2026-02-17T00:54:52.983 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T00:54:52.983 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:775: TEST_divergent_3: sleep 5 2026-02-17T00:54:53.212 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:54:53.209+0000 7f2860a1b780 -1 osd.1 28 log_to_monitors true 2026-02-17T00:54:57.984 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: echo 'delay recovery divergent' 2026-02-17T00:54:57.984 INFO:tasks.workunit.client.0.trial092.stdout:delay recovery divergent 2026-02-17T00:54:57.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:778: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:54:58.205 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:54:58.205 INFO:tasks.workunit.client.0.trial092.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340621+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:29.423180+0000 0 0 2026-02-17T00:54:58.205 INFO:tasks.workunit.client.0.trial092.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340980+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.205 INFO:tasks.workunit.client.0.trial092.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340882+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:44.449967+0000 0 0 2026-02-17T00:54:58.206 INFO:tasks.workunit.client.0.trial092.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340969+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:50.463783+0000 0 0 2026-02-17T00:54:58.206 INFO:tasks.workunit.client.0.trial092.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341103+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.206 INFO:tasks.workunit.client.0.trial092.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341324+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.206 INFO:tasks.workunit.client.0.trial092.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340869+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:49.458519+0000 0 0 2026-02-17T00:54:58.206 INFO:tasks.workunit.client.0.trial092.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342186+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.206 INFO:tasks.workunit.client.0.trial092.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342336+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.206 INFO:tasks.workunit.client.0.trial092.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342166+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.206 INFO:tasks.workunit.client.0.trial092.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342129+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.206 INFO:tasks.workunit.client.0.trial092.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341920+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.206 INFO:tasks.workunit.client.0.trial092.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342023+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.207 INFO:tasks.workunit.client.0.trial092.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342123+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.207 INFO:tasks.workunit.client.0.trial092.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340730+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.207 INFO:tasks.workunit.client.0.trial092.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340375+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:25.436484+0000 0 0 2026-02-17T00:54:58.207 INFO:tasks.workunit.client.0.trial092.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:24.024299+0000 28'100 50:164 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:15.482064+0000 0 0 2026-02-17T00:54:58.207 INFO:tasks.workunit.client.0.trial092.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342178+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.207 INFO:tasks.workunit.client.0.trial092.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:54:15.342077+0000 47'101 50:164 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.207 INFO:tasks.workunit.client.0.trial092.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342214+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:58.207 INFO:tasks.workunit.client.0.trial092.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340268+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:28.389074+0000 0 0 2026-02-17T00:54:58.207 INFO:tasks.workunit.client.0.trial092.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339955+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:40.419426+0000 0 0 2026-02-17T00:54:58.207 INFO:tasks.workunit.client.0.trial092.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340363+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:42.404707+0000 0 0 2026-02-17T00:54:58.208 INFO:tasks.workunit.client.0.trial092.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340045+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:18.474664+0000 0 0 2026-02-17T00:54:58.208 INFO:tasks.workunit.client.0.trial092.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340485+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:30.452182+0000 0 0 2026-02-17T00:54:58.208 INFO:tasks.workunit.client.0.trial092.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340778+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:39.369944+0000 0 0 2026-02-17T00:54:58.208 INFO:tasks.workunit.client.0.trial092.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340441+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:27.428781+0000 0 0 2026-02-17T00:54:58.208 INFO:tasks.workunit.client.0.trial092.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340698+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:41.399706+0000 0 0 2026-02-17T00:54:58.208 INFO:tasks.workunit.client.0.trial092.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340585+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:45.404455+0000 0 0 2026-02-17T00:54:58.208 INFO:tasks.workunit.client.0.trial092.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339942+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:24.444290+0000 0 0 2026-02-17T00:54:58.208 INFO:tasks.workunit.client.0.trial092.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340213+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:19.478970+0000 0 0 2026-02-17T00:54:58.208 INFO:tasks.workunit.client.0.trial092.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340192+0000 28'100 50:163 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:35.372026+0000 0 0 2026-02-17T00:54:58.208 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:54:58.209 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:54:58.209 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:54:58.213 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: get_asok_path osd.1 2026-02-17T00:54:58.213 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T00:54:58.214 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T00:54:58.214 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:54:58.214 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:54:58.214 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:54:58.214 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.1.asok 2026-02-17T00:54:58.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: CEPH_ARGS= 2026-02-17T00:54:58.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T00:54:58.259 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:54:58.263 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:781: TEST_divergent_3: ceph osd unset noup 2026-02-17T00:54:58.583 INFO:tasks.workunit.client.0.trial092.stderr:noup is unset 2026-02-17T00:54:58.597 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: wait_for_osd up 0 2026-02-17T00:54:58.597 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:54:58.597 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:54:58.597 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:54:58.597 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:54:58.597 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:54:58.597 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:54:58.598 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:54:58.598 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:54:58.598 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:54:58.831 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 35 up_thru 46 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/65003463,v1:127.0.0.1:6801/65003463] [v2:127.0.0.1:6802/65003463,v1:127.0.0.1:6803/65003463] exists,up 44365f2e-8c44-4cf8-9dc2-0f1042f6586a 2026-02-17T00:54:58.832 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:54:58.832 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:54:58.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:54:58.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:784: TEST_divergent_3: wait_for_osd up 1 2026-02-17T00:54:58.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:54:58.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:54:58.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:54:58.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:54:58.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:54:58.833 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:54:58.834 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:54:58.834 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:54:58.834 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:54:59.067 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 52 up_thru 52 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/2643551049,v1:127.0.0.1:6819/2643551049] [v2:127.0.0.1:6820/2643551049,v1:127.0.0.1:6821/2643551049] exists,up 88cb08c5-e268-4844-904f-02be0aa73443 2026-02-17T00:54:59.068 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:54:59.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:54:59.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:54:59.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:785: TEST_divergent_3: wait_for_osd up 2 2026-02-17T00:54:59.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:54:59.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:54:59.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:54:59.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:54:59.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:54:59.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:54:59.070 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:54:59.070 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:54:59.070 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:54:59.300 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 31 last_clean_interval [13,28) [v2:127.0.0.1:6810/1571663564,v1:127.0.0.1:6811/1571663564] [v2:127.0.0.1:6812/1571663564,v1:127.0.0.1:6813/1571663564] exists,up a0cd068a-c54e-4e63-b6cd-541c4749bcdb 2026-02-17T00:54:59.300 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:54:59.301 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:54:59.301 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:54:59.301 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:54:59.521 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:54:59.521 INFO:tasks.workunit.client.0.trial092.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340621+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:29.423180+0000 0 0 2026-02-17T00:54:59.521 INFO:tasks.workunit.client.0.trial092.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340980+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:54.501010+0000 0 0 2026-02-17T00:54:59.521 INFO:tasks.workunit.client.0.trial092.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340882+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:44.449967+0000 0 0 2026-02-17T00:54:59.521 INFO:tasks.workunit.client.0.trial092.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340969+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:50.463783+0000 0 0 2026-02-17T00:54:59.521 INFO:tasks.workunit.client.0.trial092.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341103+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:57.384169+0000 0 0 2026-02-17T00:54:59.521 INFO:tasks.workunit.client.0.trial092.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341324+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.522 INFO:tasks.workunit.client.0.trial092.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340869+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:49.458519+0000 0 0 2026-02-17T00:54:59.522 INFO:tasks.workunit.client.0.trial092.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342186+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.522 INFO:tasks.workunit.client.0.trial092.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342336+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.522 INFO:tasks.workunit.client.0.trial092.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342166+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.522 INFO:tasks.workunit.client.0.trial092.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342129+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.522 INFO:tasks.workunit.client.0.trial092.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341920+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.522 INFO:tasks.workunit.client.0.trial092.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342023+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.522 INFO:tasks.workunit.client.0.trial092.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342123+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.522 INFO:tasks.workunit.client.0.trial092.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340730+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:56.428291+0000 0 0 2026-02-17T00:54:59.522 INFO:tasks.workunit.client.0.trial092.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340375+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:25.436484+0000 0 0 2026-02-17T00:54:59.522 INFO:tasks.workunit.client.0.trial092.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:24.024299+0000 28'100 51:166 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:15.482064+0000 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342178+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:54:15.342077+0000 47'101 51:166 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342214+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340268+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:28.389074+0000 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339955+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:40.419426+0000 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340363+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:42.404707+0000 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340045+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:18.474664+0000 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340485+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:30.452182+0000 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340778+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:39.369944+0000 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340441+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:27.428781+0000 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340698+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:41.399706+0000 0 0 2026-02-17T00:54:59.523 INFO:tasks.workunit.client.0.trial092.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340585+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:45.404455+0000 0 0 2026-02-17T00:54:59.524 INFO:tasks.workunit.client.0.trial092.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339942+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:24.444290+0000 0 0 2026-02-17T00:54:59.524 INFO:tasks.workunit.client.0.trial092.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340213+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:19.478970+0000 0 0 2026-02-17T00:54:59.524 INFO:tasks.workunit.client.0.trial092.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340192+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:35.372026+0000 0 0 2026-02-17T00:54:59.524 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:54:59.524 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:54:59.524 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:54:59.528 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: echo 'wait for peering' 2026-02-17T00:54:59.529 INFO:tasks.workunit.client.0.trial092.stdout:wait for peering 2026-02-17T00:54:59.529 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:789: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:54:59.745 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:54:59.745 INFO:tasks.workunit.client.0.trial092.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340621+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:29.423180+0000 0 0 2026-02-17T00:54:59.745 INFO:tasks.workunit.client.0.trial092.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340980+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:54.501010+0000 0 0 2026-02-17T00:54:59.745 INFO:tasks.workunit.client.0.trial092.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340882+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:44.449967+0000 0 0 2026-02-17T00:54:59.745 INFO:tasks.workunit.client.0.trial092.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340969+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:50.463783+0000 0 0 2026-02-17T00:54:59.745 INFO:tasks.workunit.client.0.trial092.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341103+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:57.384169+0000 0 0 2026-02-17T00:54:59.745 INFO:tasks.workunit.client.0.trial092.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341324+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.745 INFO:tasks.workunit.client.0.trial092.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340869+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:49.458519+0000 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342186+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342336+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342166+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342129+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341920+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342023+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342123+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340730+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:56.428291+0000 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340375+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:25.436484+0000 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:24.024299+0000 28'100 51:166 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:15.482064+0000 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342178+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.746 INFO:tasks.workunit.client.0.trial092.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:54:15.342077+0000 47'101 51:166 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342214+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340268+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:28.389074+0000 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339955+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:40.419426+0000 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340363+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:42.404707+0000 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340045+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:18.474664+0000 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340485+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:30.452182+0000 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340778+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:39.369944+0000 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340441+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:27.428781+0000 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340698+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:41.399706+0000 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340585+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:45.404455+0000 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339942+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:24.444290+0000 0 0 2026-02-17T00:54:59.747 INFO:tasks.workunit.client.0.trial092.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340213+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:19.478970+0000 0 0 2026-02-17T00:54:59.748 INFO:tasks.workunit.client.0.trial092.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340192+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:35.372026+0000 0 0 2026-02-17T00:54:59.748 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:54:59.748 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:54:59.748 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:54:59.751 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:790: TEST_divergent_3: rados -p test put foo /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:54:59.772 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:791: TEST_divergent_3: rm -f /tmp/tmp.IdZzGNRuJ6 2026-02-17T00:54:59.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: rm -f /tmp/tmp.T13Jc6reTs 2026-02-17T00:54:59.774 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:796: TEST_divergent_3: echo 'killing divergent 1' 2026-02-17T00:54:59.774 INFO:tasks.workunit.client.0.trial092.stdout:killing divergent 1 2026-02-17T00:54:59.774 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:55:00.002 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:55:00.002 INFO:tasks.workunit.client.0.trial092.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340621+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:29.423180+0000 0 0 2026-02-17T00:55:00.002 INFO:tasks.workunit.client.0.trial092.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340980+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:54.501010+0000 0 0 2026-02-17T00:55:00.002 INFO:tasks.workunit.client.0.trial092.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340882+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:44.449967+0000 0 0 2026-02-17T00:55:00.002 INFO:tasks.workunit.client.0.trial092.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340969+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:50.463783+0000 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341103+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:57.384169+0000 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341324+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340869+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:49.458519+0000 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342186+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342336+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342166+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342129+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341920+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342023+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342123+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340730+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:56.428291+0000 0 0 2026-02-17T00:55:00.003 INFO:tasks.workunit.client.0.trial092.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340375+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:25.436484+0000 0 0 2026-02-17T00:55:00.004 INFO:tasks.workunit.client.0.trial092.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:24.024299+0000 28'100 51:166 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:15.482064+0000 0 0 2026-02-17T00:55:00.004 INFO:tasks.workunit.client.0.trial092.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342178+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.004 INFO:tasks.workunit.client.0.trial092.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:54:15.342077+0000 47'101 51:166 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.004 INFO:tasks.workunit.client.0.trial092.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342214+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.004 INFO:tasks.workunit.client.0.trial092.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340268+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:28.389074+0000 0 0 2026-02-17T00:55:00.004 INFO:tasks.workunit.client.0.trial092.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339955+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:40.419426+0000 0 0 2026-02-17T00:55:00.004 INFO:tasks.workunit.client.0.trial092.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340363+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:42.404707+0000 0 0 2026-02-17T00:55:00.004 INFO:tasks.workunit.client.0.trial092.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340045+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:18.474664+0000 0 0 2026-02-17T00:55:00.004 INFO:tasks.workunit.client.0.trial092.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340485+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:30.452182+0000 0 0 2026-02-17T00:55:00.004 INFO:tasks.workunit.client.0.trial092.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340778+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:39.369944+0000 0 0 2026-02-17T00:55:00.004 INFO:tasks.workunit.client.0.trial092.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340441+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:27.428781+0000 0 0 2026-02-17T00:55:00.005 INFO:tasks.workunit.client.0.trial092.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340698+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:41.399706+0000 0 0 2026-02-17T00:55:00.005 INFO:tasks.workunit.client.0.trial092.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340585+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:45.404455+0000 0 0 2026-02-17T00:55:00.005 INFO:tasks.workunit.client.0.trial092.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339942+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:24.444290+0000 0 0 2026-02-17T00:55:00.005 INFO:tasks.workunit.client.0.trial092.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340213+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:19.478970+0000 0 0 2026-02-17T00:55:00.005 INFO:tasks.workunit.client.0.trial092.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340192+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:35.372026+0000 0 0 2026-02-17T00:55:00.005 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:55:00.005 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:55:00.005 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:55:00.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:798: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T00:55:00.010 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:55:00.010 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:55:00.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:55:00.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:55:00.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:55:00.116 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:55:00.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:801: TEST_divergent_3: expfile=td/divergent-priors/exp.44472.out 2026-02-17T00:55:00.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.44472.out 2026-02-17T00:55:00.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T00:55:00.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T00:55:00.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T00:55:00.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T00:55:00.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T00:55:00.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.44472.out 2026-02-17T00:55:00.223 INFO:tasks.workunit.client.0.trial092.stderr:Exporting 1.0 info 1.0( v 28'100 (28'90,28'100] local-lis/les=52/53 n=3 ec=20/20 lis/c=52/52 les/c/f=53/53/0 sis=52) 2026-02-17T00:55:00.223 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-17T00:55:00.223 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-17T00:55:00.223 INFO:tasks.workunit.client.0.trial092.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-17T00:55:00.223 INFO:tasks.workunit.client.0.trial092.stderr:Export successful 2026-02-17T00:55:00.224 INFO:tasks.workunit.client.0.trial092.stdout: marking collection for removal 2026-02-17T00:55:00.224 INFO:tasks.workunit.client.0.trial092.stdout:setting '_remove' omap key 2026-02-17T00:55:00.224 INFO:tasks.workunit.client.0.trial092.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-17T00:55:00.224 INFO:tasks.workunit.client.0.trial092.stderr:Remove successful 2026-02-17T00:55:00.268 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.44472.out 2026-02-17T00:55:00.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T00:55:00.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T00:55:00.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T00:55:00.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T00:55:00.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T00:55:00.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.44472.out 2026-02-17T00:55:00.366 INFO:tasks.workunit.client.0.trial092.stdout:get_pg_num_history pg_num_history pg_num_history(e54 pg_nums {1={20=1,46=32}} deleted_pools ) 2026-02-17T00:55:00.366 INFO:tasks.workunit.client.0.trial092.stdout:Importing pgid 1.0 2026-02-17T00:55:00.366 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-17T00:55:00.367 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:55:00.367 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-17T00:55:00.367 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:55:00.367 INFO:tasks.workunit.client.0.trial092.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-17T00:55:00.367 INFO:tasks.workunit.client.0.trial092.stdout:snapset 0={} 2026-02-17T00:55:00.367 INFO:tasks.workunit.client.0.trial092.stdout:write_pg epoch 53 info 1.0( v 28'100 (28'90,28'100] local-lis/les=52/53 n=3 ec=20/20 lis/c=52/52 les/c/f=53/53/0 sis=52) 2026-02-17T00:55:00.367 INFO:tasks.workunit.client.0.trial092.stdout:Import successful 2026-02-17T00:55:00.405 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:805: TEST_divergent_3: echo 'reviving divergent 1' 2026-02-17T00:55:00.405 INFO:tasks.workunit.client.0.trial092.stdout:reviving divergent 1 2026-02-17T00:55:00.405 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:55:00.624 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:55:00.624 INFO:tasks.workunit.client.0.trial092.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340621+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:29.423180+0000 0 0 2026-02-17T00:55:00.624 INFO:tasks.workunit.client.0.trial092.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340980+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:54.501010+0000 0 0 2026-02-17T00:55:00.625 INFO:tasks.workunit.client.0.trial092.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340882+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:44.449967+0000 0 0 2026-02-17T00:55:00.625 INFO:tasks.workunit.client.0.trial092.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340969+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:50.463783+0000 0 0 2026-02-17T00:55:00.625 INFO:tasks.workunit.client.0.trial092.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341103+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:57.384169+0000 0 0 2026-02-17T00:55:00.625 INFO:tasks.workunit.client.0.trial092.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341324+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.625 INFO:tasks.workunit.client.0.trial092.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340869+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:49.458519+0000 0 0 2026-02-17T00:55:00.625 INFO:tasks.workunit.client.0.trial092.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342186+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.625 INFO:tasks.workunit.client.0.trial092.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342336+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.625 INFO:tasks.workunit.client.0.trial092.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342166+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.625 INFO:tasks.workunit.client.0.trial092.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342129+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.625 INFO:tasks.workunit.client.0.trial092.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.341920+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.625 INFO:tasks.workunit.client.0.trial092.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342023+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342123+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340730+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:56.428291+0000 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340375+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:25.436484+0000 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:24.024299+0000 28'100 51:166 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:15.482064+0000 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342178+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-17T00:54:15.342077+0000 47'101 51:166 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.342214+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340268+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:28.389074+0000 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339955+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:40.419426+0000 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340363+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:42.404707+0000 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340045+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:18.474664+0000 0 0 2026-02-17T00:55:00.626 INFO:tasks.workunit.client.0.trial092.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340485+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:30.452182+0000 0 0 2026-02-17T00:55:00.627 INFO:tasks.workunit.client.0.trial092.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340778+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:39.369944+0000 0 0 2026-02-17T00:55:00.627 INFO:tasks.workunit.client.0.trial092.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340441+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:27.428781+0000 0 0 2026-02-17T00:55:00.627 INFO:tasks.workunit.client.0.trial092.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340698+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:41.399706+0000 0 0 2026-02-17T00:55:00.627 INFO:tasks.workunit.client.0.trial092.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340585+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:45.404455+0000 0 0 2026-02-17T00:55:00.627 INFO:tasks.workunit.client.0.trial092.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.339942+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:24.444290+0000 0 0 2026-02-17T00:55:00.627 INFO:tasks.workunit.client.0.trial092.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340213+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:19.478970+0000 0 0 2026-02-17T00:55:00.627 INFO:tasks.workunit.client.0.trial092.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-17T00:54:15.340192+0000 28'100 51:165 [0,2] 0 [0,2] 0 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 user requested scrub scheduled @ 2026-02-17T00:55:35.372026+0000 0 0 2026-02-17T00:55:00.627 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:55:00.627 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:55:00.627 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:55:00.634 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-17T00:55:00.634 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:55:00.634 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:55:00.634 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T00:55:00.634 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:55:00.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:55:00.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:55:00.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:55:00.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:55:00.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:55:00.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:55:00.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:55:00.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:55:00.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:55:00.635 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:55:00.635 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:55:00.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:55:00.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:55:00.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:55:00.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:55:00.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:55:00.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T00:55:00.637 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:55:00.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:55:00.638 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T00:55:00.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T00:55:00.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:55:00.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:55:00.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:55:00.652 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:00.649+0000 7fb4d2655780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:00.653 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:00.651+0000 7fb4d2655780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:00.654 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:00.651+0000 7fb4d2655780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:00.809 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:00.806+0000 7fb4d2655780 -1 Falling back to public interface 2026-02-17T00:55:00.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T00:55:00.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:55:00.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:55:00.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:55:00.865 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:55:00.865 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:55:00.865 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:55:00.866 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:55:00.866 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:55:00.866 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:55:01.097 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 52 up_thru 52 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/2643551049,v1:127.0.0.1:6819/2643551049] [v2:127.0.0.1:6820/2643551049,v1:127.0.0.1:6821/2643551049] exists,up 88cb08c5-e268-4844-904f-02be0aa73443 2026-02-17T00:55:01.098 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:55:01.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:55:01.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:55:01.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: wait_for_osd up 1 2026-02-17T00:55:01.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:55:01.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:55:01.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:55:01.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:55:01.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:55:01.100 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:55:01.100 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:55:01.100 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:55:01.100 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:55:01.134 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:01.131+0000 7fb4d2655780 -1 osd.1 54 log_to_monitors true 2026-02-17T00:55:01.335 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:55:02.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:55:02.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:55:02.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:55:02.337 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:55:02.337 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:55:02.337 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:55:02.569 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 57 up_thru 57 down_at 56 last_clean_interval [52,54) [v2:127.0.0.1:6818/780073383,v1:127.0.0.1:6819/780073383] [v2:127.0.0.1:6820/780073383,v1:127.0.0.1:6821/780073383] exists,up 88cb08c5-e268-4844-904f-02be0aa73443 2026-02-17T00:55:02.569 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:55:02.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:55:02.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:55:02.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: sleep 20 2026-02-17T00:55:22.571 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: get_asok_path osd.1 2026-02-17T00:55:22.572 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T00:55:22.572 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T00:55:22.572 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:55:22.572 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:22.572 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:22.572 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.1.asok 2026-02-17T00:55:22.573 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: CEPH_ARGS= 2026-02-17T00:55:22.573 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T00:55:22.617 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:55:22.617 INFO:tasks.workunit.client.0.trial092.stdout: "ops": [], 2026-02-17T00:55:22.617 INFO:tasks.workunit.client.0.trial092.stdout: "num_ops": 0 2026-02-17T00:55:22.617 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:55:22.621 INFO:tasks.workunit.client.0.trial092.stdout:allowing recovery 2026-02-17T00:55:22.622 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:813: TEST_divergent_3: echo 'allowing recovery' 2026-02-17T00:55:22.622 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:55:22.841 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:55:22.841 INFO:tasks.workunit.client.0.trial092.stdout:1.1f 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T00:55:11.390792+0000 28'100 69:192 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-17T00:55:02.183564+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T07:34:32.901354+0000 3 0 2026-02-17T00:55:22.841 INFO:tasks.workunit.client.0.trial092.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T00:55:17.390436+0000 28'100 69:180 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.842 INFO:tasks.workunit.client.0.trial092.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:07.391522+0000 28'100 69:163 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.842 INFO:tasks.workunit.client.0.trial092.stdout:1.b 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:16.203843+0000 28'100 69:194 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-17T00:55:16.203807+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T09:17:27.673840+0000 3 0 2026-02-17T00:55:22.842 INFO:tasks.workunit.client.0.trial092.stdout:1.a 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T00:55:17.421923+0000 28'100 68:201 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T00:55:17.421895+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T11:23:17.437329+0000 3 0 2026-02-17T00:55:22.842 INFO:tasks.workunit.client.0.trial092.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-17T00:55:16.144875+0000 28'100 69:171 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T00:55:16.144833+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T03:29:05.884294+0000 5 0 2026-02-17T00:55:22.842 INFO:tasks.workunit.client.0.trial092.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:10.144496+0000 28'100 69:197 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:10.144439+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:46.009609+0000 3 0 2026-02-17T00:55:22.842 INFO:tasks.workunit.client.0.trial092.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:11.391233+0000 28'100 69:184 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.842 INFO:tasks.workunit.client.0.trial092.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-17T00:55:17.390281+0000 54'101 69:180 [1,0,2] 1 [1,0,2] 1 54'101 2026-02-17T00:55:10.472223+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.842 INFO:tasks.workunit.client.0.trial092.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:07.391994+0000 28'100 69:163 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.842 INFO:tasks.workunit.client.0.trial092.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:01.457445+0000 28'100 69:188 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.842 INFO:tasks.workunit.client.0.trial092.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T00:55:11.391417+0000 28'100 69:186 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.842 INFO:tasks.workunit.client.0.trial092.stdout:1.2 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T00:55:16.400428+0000 28'100 68:201 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T00:55:16.400402+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:28:37.874275+0000 1 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-17T00:55:01.457423+0000 28'100 69:189 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.1 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-17T00:55:13.159811+0000 28'100 69:171 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T00:55:13.159786+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T06:50:52.531376+0000 2 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.1c 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-17T00:55:03.144292+0000 28'100 69:196 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:03.144259+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T03:58:51.891847+0000 2 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:09.174394+0000 28'100 69:197 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:09.174364+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T12:26:35.937649+0000 3 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:07.391765+0000 28'100 69:163 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.e 3 0 0 0 0 2088 0 0 14 87 14 active+clean 2026-02-17T00:55:17.390286+0000 47'101 69:181 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:11.391234+0000 28'100 69:184 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:13.183257+0000 28'100 69:197 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:13.183211+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T12:29:23.740739+0000 3 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T00:55:12.145910+0000 28'100 69:171 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T00:55:12.145883+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T05:09:06.157266+0000 3 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T00:55:15.417992+0000 28'100 68:201 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T00:55:15.417967+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T06:51:15.313505+0000 1 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.13 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:17.240457+0000 28'100 69:194 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-17T00:55:17.240414+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T06:37:11.930116+0000 3 0 2026-02-17T00:55:22.843 INFO:tasks.workunit.client.0.trial092.stdout:1.14 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:06.246398+0000 28'100 69:197 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:06.246365+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T05:39:52.476287+0000 3 0 2026-02-17T00:55:22.844 INFO:tasks.workunit.client.0.trial092.stdout:1.15 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T00:55:09.096243+0000 28'100 69:171 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T00:55:09.096219+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T08:59:46.370924+0000 3 0 2026-02-17T00:55:22.844 INFO:tasks.workunit.client.0.trial092.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:17.390421+0000 28'100 69:178 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.844 INFO:tasks.workunit.client.0.trial092.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:11.390870+0000 28'100 69:184 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.844 INFO:tasks.workunit.client.0.trial092.stdout:1.18 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:18.231595+0000 28'100 69:197 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:18.231572+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T02:55:46.899689+0000 3 0 2026-02-17T00:55:22.844 INFO:tasks.workunit.client.0.trial092.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-17T00:55:10.090340+0000 28'100 69:171 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T00:55:10.090301+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T01:15:18.013784+0000 2 0 2026-02-17T00:55:22.844 INFO:tasks.workunit.client.0.trial092.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-17T00:55:13.418978+0000 28'100 68:200 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T00:55:13.418947+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T01:11:36.526752+0000 4 0 2026-02-17T00:55:22.844 INFO:tasks.workunit.client.0.trial092.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T00:55:11.391340+0000 28'100 69:187 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:22.844 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:55:22.844 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:55:22.845 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:55:22.848 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-17T00:55:22.848 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T00:55:22.910 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:55:22.914 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-17T00:55:22.914 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T00:55:22.975 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:55:22.979 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-17T00:55:22.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T00:55:23.040 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:55:23.045 INFO:tasks.workunit.client.0.trial092.stdout:reading divergent objects 2026-02-17T00:55:23.046 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: echo 'reading divergent objects' 2026-02-17T00:55:23.046 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: ceph pg dump pgs 2026-02-17T00:55:23.269 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:55:23.269 INFO:tasks.workunit.client.0.trial092.stdout:1.1f 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T00:55:11.390792+0000 28'100 69:192 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-17T00:55:02.183564+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T07:34:32.901354+0000 3 0 2026-02-17T00:55:23.269 INFO:tasks.workunit.client.0.trial092.stdout:1.1e 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T00:55:17.390436+0000 28'100 69:180 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.269 INFO:tasks.workunit.client.0.trial092.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:07.391522+0000 28'100 69:163 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.269 INFO:tasks.workunit.client.0.trial092.stdout:1.b 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:16.203843+0000 28'100 69:194 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-17T00:55:16.203807+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T09:17:27.673840+0000 3 0 2026-02-17T00:55:23.269 INFO:tasks.workunit.client.0.trial092.stdout:1.a 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T00:55:17.421923+0000 28'100 68:201 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T00:55:17.421895+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T11:23:17.437329+0000 3 0 2026-02-17T00:55:23.269 INFO:tasks.workunit.client.0.trial092.stdout:1.9 5 0 0 0 0 2560 0 0 16 84 16 active+clean 2026-02-17T00:55:16.144875+0000 28'100 69:171 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T00:55:16.144833+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T03:29:05.884294+0000 5 0 2026-02-17T00:55:23.269 INFO:tasks.workunit.client.0.trial092.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:10.144496+0000 28'100 69:197 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:10.144439+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T04:12:46.009609+0000 3 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:11.391233+0000 28'100 69:184 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-17T00:55:17.390281+0000 54'101 69:180 [1,0,2] 1 [1,0,2] 1 54'101 2026-02-17T00:55:10.472223+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:07.391994+0000 28'100 69:163 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:01.457445+0000 28'100 69:188 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T00:55:11.391417+0000 28'100 69:186 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.2 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T00:55:16.400428+0000 28'100 68:201 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T00:55:16.400402+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:28:37.874275+0000 1 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-17T00:55:01.457423+0000 28'100 69:189 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.1 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-17T00:55:13.159811+0000 28'100 69:171 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T00:55:13.159786+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T06:50:52.531376+0000 2 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.1c 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-17T00:55:03.144292+0000 28'100 69:196 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:03.144259+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T03:58:51.891847+0000 2 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:09.174394+0000 28'100 69:197 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:09.174364+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T12:26:35.937649+0000 3 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:07.391765+0000 28'100 69:163 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.e 3 0 0 0 0 2088 0 0 14 87 14 active+clean 2026-02-17T00:55:17.390286+0000 47'101 69:181 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:11.391234+0000 28'100 69:184 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:13.183257+0000 28'100 69:197 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:13.183211+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T12:29:23.740739+0000 3 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T00:55:12.145910+0000 28'100 69:171 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T00:55:12.145883+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T05:09:06.157266+0000 3 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.12 1 0 0 0 0 512 0 0 16 84 16 active+clean 2026-02-17T00:55:15.417992+0000 28'100 68:201 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T00:55:15.417967+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T06:51:15.313505+0000 1 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.13 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:17.240457+0000 28'100 69:194 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-17T00:55:17.240414+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T06:37:11.930116+0000 3 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.14 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:06.246398+0000 28'100 69:197 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:06.246365+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T05:39:52.476287+0000 3 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.15 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-17T00:55:09.096243+0000 28'100 69:171 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T00:55:09.096219+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T08:59:46.370924+0000 3 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.16 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:17.390421+0000 28'100 69:178 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-17T00:55:11.390870+0000 28'100 69:184 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.18 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-17T00:55:18.231595+0000 28'100 69:197 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-17T00:55:18.231572+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T02:55:46.899689+0000 3 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-17T00:55:10.090340+0000 28'100 69:171 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-17T00:55:10.090301+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T01:15:18.013784+0000 2 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.1a 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-17T00:55:13.418978+0000 28'100 68:200 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-17T00:55:13.418947+0000 0'0 2026-02-17T00:53:20.808721+0000 0 1 periodic scrub scheduled @ 2026-02-18T01:11:36.526752+0000 4 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-17T00:55:11.391340+0000 28'100 69:187 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T00:53:20.808721+0000 0'0 2026-02-17T00:53:20.808721+0000 0 0 queued for scrub 0 0 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:55:23.270 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:55:23.271 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:55:23.278 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: expr 2 + 2 2026-02-17T00:55:23.279 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: seq 1 4 2026-02-17T00:55:23.280 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:55:23.280 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T00:55:23.299 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:55:23.300 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T00:55:23.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:55:23.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T00:55:23.365 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:55:23.365 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T00:55:23.383 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: seq 1 2 2026-02-17T00:55:23.384 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T00:55:23.384 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-17T00:55:23.402 INFO:tasks.workunit.client.0.trial092.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-17T00:55:23.402 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T00:55:23.403 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-17T00:55:23.419 INFO:tasks.workunit.client.0.trial092.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-17T00:55:23.421 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: rm -f td/divergent-priors/existing 2026-02-17T00:55:23.422 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T00:55:23.423 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-17T00:55:23.429 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.895+0000 7f283db56640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4545.0:1 2026-02-17T00:53:35.966609+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:55:23.429 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.895+0000 7f283db56640 20 _merge_object_divergent_entries: keeping 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4545.0:1 2026-02-17T00:53:35.966609+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:55:23.429 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.895+0000 7f283db56640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.895+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 28'2 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.895+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.895+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.895+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 28'106 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.895+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4545.0:1 2026-02-17T00:53:35.966609+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.895+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.895+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 28'2 <= info.log_tail 28'89 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.899+0000 7f283b351640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-17T00:53:35.968948+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.899+0000 7f283b351640 20 _merge_object_divergent_entries: keeping 28'106 (28'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-17T00:53:35.968948+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.899+0000 7f283b351640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.899+0000 7f283b351640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 28'4 first_divergent_update: 28'106 last_divergent_update: 28'106 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.899+0000 7f283b351640 10 _merge_object_divergent_entries: more recent entry found: 47'101 (28'4) modify 1:70b3bf12:::existing_4:head by client.4658.0:1 2026-02-17T00:54:22.680706+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.899+0000 7f283b351640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 28'102 (0'0) modify 1:75ac5091:::newobject_2:head by client.4537.0:1 2026-02-17T00:53:35.962322+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.899+0000 7f283b351640 20 _merge_object_divergent_entries: keeping 28'102 (0'0) modify 1:75ac5091:::newobject_2:head by client.4537.0:1 2026-02-17T00:53:35.962322+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.899+0000 7f283b351640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.899+0000 7f283b351640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 28'102 last_divergent_update: 28'102 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.899+0000 7f283b351640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.899+0000 7f283b351640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4544.0:1 2026-02-17T00:53:35.966763+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 20 _merge_object_divergent_entries: keeping 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4544.0:1 2026-02-17T00:53:35.966763+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 28'1 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-17T00:55:23.430 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-17T00:55:23.431 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-17T00:55:23.431 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 28'106 2026-02-17T00:55:23.431 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4544.0:1 2026-02-17T00:53:35.966763+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:55:23.431 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-17T00:55:23.431 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 28'1 <= info.log_tail 28'90 2026-02-17T00:55:23.431 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 28'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4536.0:1 2026-02-17T00:53:35.962018+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T00:55:23.431 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 20 _merge_object_divergent_entries: keeping 28'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4536.0:1 2026-02-17T00:53:35.962018+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.900+0000 7f283cb54640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.901+0000 7f283db56640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4547.0:1 2026-02-17T00:53:35.967354+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.901+0000 7f283db56640 20 _merge_object_divergent_entries: keeping 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4547.0:1 2026-02-17T00:53:35.967354+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.901+0000 7f283db56640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.901+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 28'3 first_divergent_update: 28'105 last_divergent_update: 28'105 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.901+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.901+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.901+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 28'106 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.901+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 28'105 (28'3) delete 1:8881e6d8:::existing_3:head by client.4547.0:1 2026-02-17T00:53:35.967354+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.902+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:54:58.902+0000 7f283db56640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 28'3 <= info.log_tail 28'84 2026-02-17T00:55:23.436 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T00:55:23.437 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-17T00:55:23.443 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T00:55:23.444 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-17T00:55:23.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:846: TEST_divergent_3: echo success 2026-02-17T00:55:23.450 INFO:tasks.workunit.client.0.trial092.stdout:success 2026-02-17T00:55:23.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:848: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.44472.out 2026-02-17T00:55:23.451 INFO:tasks.workunit.client.0.trial092.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.44472.out': No such file or directory 2026-02-17T00:55:23.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:849: TEST_divergent_3: delete_pool test 2026-02-17T00:55:23.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T00:55:23.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T00:55:23.724 INFO:tasks.workunit.client.0.trial092.stderr:pool 'test' does not exist 2026-02-17T00:55:23.732 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:850: TEST_divergent_3: kill_daemons td/divergent-priors 2026-02-17T00:55:23.733 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:55:23.733 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:55:23.733 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:55:23.733 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:55:23.733 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:55:29.047 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:55:29.047 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T00:55:29.048 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T00:55:29.048 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:55:29.048 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T00:55:29.048 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:55:29.048 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:55:29.049 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:55:29.049 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:55:29.049 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:55:29.054 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:55:29.054 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:55:29.055 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:55:29.055 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:55:29.056 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:55:29.056 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:55:29.056 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:55:29.057 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:55:29.057 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:55:29.058 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:55:29.058 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:55:29.058 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:55:29.059 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:55:29.059 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T00:55:29.083 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:55:29.083 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:29.083 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:29.083 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44472 2026-02-17T00:55:29.085 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:55:29.085 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:55:29.085 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T00:55:29.085 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T00:55:29.085 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-17T00:55:29.085 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-17T00:55:29.085 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T00:55:29.085 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:55:29.086 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T00:55:29.086 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:55:29.086 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:55:29.086 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:55:29.086 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:55:29.086 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:55:29.086 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:55:29.087 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:55:29.087 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:55:29.087 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:55:29.088 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:55:29.088 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:55:29.089 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:55:29.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:55:29.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:55:29.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:55:29.090 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:55:29.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:55:29.091 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:55:29.092 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T00:55:29.093 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:55:29.093 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:29.093 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:29.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44472 2026-02-17T00:55:29.094 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:55:29.094 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:55:29.094 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-17T00:55:29.095 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T00:55:29.095 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:29.095 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:29.095 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.44472 2026-02-17T00:55:29.096 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T00:55:29.097 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T00:55:29.097 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T00:55:29.097 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T00:55:29.098 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2026-02-17T00:55:29.098 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:227: TEST_divergent_ec: local dir=td/divergent-priors 2026-02-17T00:55:29.098 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: file_with_random_data 2026-02-17T00:55:29.098 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=512 2026-02-17T00:55:29.098 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T00:55:29.098 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:29.099 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.GRJdY5VaAe bs=512 count=1 2026-02-17T00:55:29.099 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records in 2026-02-17T00:55:29.099 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records out 2026-02-17T00:55:29.100 INFO:tasks.workunit.client.0.trial092.stderr:512 bytes copied, 5.7677e-05 s, 8.9 MB/s 2026-02-17T00:55:29.100 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:29.100 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: local dummyfile=/tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:29.100 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: file_with_random_data 1000 2026-02-17T00:55:29.100 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2343: file_with_random_data: local size_bytes=1000 2026-02-17T00:55:29.101 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: mktemp 2026-02-17T00:55:29.101 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local file=/tmp/tmp.1QlqPjU3qX 2026-02-17T00:55:29.101 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.1QlqPjU3qX bs=1000 count=1 2026-02-17T00:55:29.102 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records in 2026-02-17T00:55:29.102 INFO:tasks.workunit.client.0.trial092.stderr:1+0 records out 2026-02-17T00:55:29.102 INFO:tasks.workunit.client.0.trial092.stderr:1000 bytes (1.0 kB) copied, 5.3549e-05 s, 18.7 MB/s 2026-02-17T00:55:29.102 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: printf %s /tmp/tmp.1QlqPjU3qX 2026-02-17T00:55:29.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile2=/tmp/tmp.1QlqPjU3qX 2026-02-17T00:55:29.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:233: TEST_divergent_ec: local num_osds=3 2026-02-17T00:55:29.103 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: expr 3 - 1 2026-02-17T00:55:29.103 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: seq 0 2 2026-02-17T00:55:29.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local 'osds=0 2026-02-17T00:55:29.105 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:55:29.105 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:55:29.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: run_mon td/divergent-priors a 2026-02-17T00:55:29.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-17T00:55:29.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T00:55:29.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T00:55:29.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T00:55:29.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-17T00:55:29.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T00:55:29.125 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T00:55:29.125 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:55:29.126 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:55:29.126 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:55:29.126 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:29.126 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:29.126 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:55:29.126 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T00:55:29.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T00:55:29.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T00:55:29.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:55:29.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:55:29.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T00:55:29.154 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T00:55:29.154 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:55:29.154 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:55:29.154 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:55:29.154 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:55:29.154 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:29.154 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:29.154 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-mon.a.asok 2026-02-17T00:55:29.154 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:55:29.154 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.44472/ceph-mon.a.asok config get fsid 2026-02-17T00:55:29.197 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T00:55:29.197 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:55:29.197 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:55:29.197 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T00:55:29.197 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T00:55:29.199 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:55:29.199 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:55:29.199 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:55:29.199 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:55:29.199 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:29.199 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:29.199 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-mon.a.asok 2026-02-17T00:55:29.199 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:55:29.199 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.44472/ceph-mon.a.asok config get mon_host 2026-02-17T00:55:29.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mgr td/divergent-priors x 2026-02-17T00:55:29.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-17T00:55:29.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T00:55:29.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T00:55:29.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T00:55:29.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-17T00:55:29.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T00:55:29.342 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T00:55:29.343 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:55:29.343 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:55:29.343 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:55:29.343 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:29.343 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:29.343 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:55:29.344 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:55:29.344 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:55:29.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-17T00:55:29.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 0 2026-02-17T00:55:29.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:55:29.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:55:29.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T00:55:29.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:55:29.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T00:55:29.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:55:29.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:55:29.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:55:29.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:55:29.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T00:55:29.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T00:55:29.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:55:29.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:55:29.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:55:29.364 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:55:29.364 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:55:29.364 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:55:29.367 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:55:29.367 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:29.367 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:29.367 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:55:29.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:55:29.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:55:29.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:55:29.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:55:29.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:55:29.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:55:29.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:55:29.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:55:29.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:55:29.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:55:29.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:55:29.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:55:29.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T00:55:29.368 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:55:29.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b75a4676-94b7-4664-91a3-24464591fad4 2026-02-17T00:55:29.369 INFO:tasks.workunit.client.0.trial092.stdout:add osd0 b75a4676-94b7-4664-91a3-24464591fad4 2026-02-17T00:55:29.369 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 b75a4676-94b7-4664-91a3-24464591fad4' 2026-02-17T00:55:29.369 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:55:29.380 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCBvJNpYmR6FhAAvQIbzpxI1sT34Z1cCEHk2A== 2026-02-17T00:55:29.380 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCBvJNpYmR6FhAAvQIbzpxI1sT34Z1cCEHk2A=="}' 2026-02-17T00:55:29.380 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b75a4676-94b7-4664-91a3-24464591fad4 -i td/divergent-priors/0/new.json 2026-02-17T00:55:29.484 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:55:29.490 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T00:55:29.491 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCBvJNpYmR6FhAAvQIbzpxI1sT34Z1cCEHk2A== --osd-uuid b75a4676-94b7-4664-91a3-24464591fad4 2026-02-17T00:55:29.512 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:29.510+0000 7f10f240e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:29.513 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:29.511+0000 7f10f240e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:29.514 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:29.512+0000 7f10f240e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:29.515 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:29.512+0000 7f10f240e780 -1 bdev(0x248ec00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T00:55:29.515 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:29.512+0000 7f10f240e780 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T00:55:29.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T00:55:29.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:55:29.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T00:55:29.904 INFO:tasks.workunit.client.0.trial092.stdout:adding osd0 key to auth repository 2026-02-17T00:55:29.904 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:55:30.008 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:55:30.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T00:55:30.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:55:30.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:55:30.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:55:30.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:55:30.027 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:30.024+0000 7ff678031780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:30.028 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:30.026+0000 7ff678031780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:30.029 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:30.027+0000 7ff678031780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T00:55:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:55:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:55:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:55:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:55:30.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:55:30.112 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:55:30.112 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:55:30.113 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:55:30.113 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:55:30.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:55:30.264 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:30.262+0000 7ff678031780 -1 Falling back to public interface 2026-02-17T00:55:30.559 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:30.556+0000 7ff678031780 -1 osd.0 0 log_to_monitors true 2026-02-17T00:55:31.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:55:31.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:55:31.213 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:55:31.213 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:55:31.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:55:31.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:55:31.315 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3928190507,v1:127.0.0.1:6801/3928190507] [v2:127.0.0.1:6802/3928190507,v1:127.0.0.1:6803/3928190507] exists,up b75a4676-94b7-4664-91a3-24464591fad4 2026-02-17T00:55:31.319 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:55:31.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:55:31.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:55:31.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-17T00:55:31.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 1 2026-02-17T00:55:31.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:55:31.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:55:31.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T00:55:31.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:55:31.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:55:31.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:55:31.321 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:55:31.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:55:31.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:55:31.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:55:31.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:55:31.323 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:55:31.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=0b8cd378-df63-4db1-b324-92cb2f73843e 2026-02-17T00:55:31.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 0b8cd378-df63-4db1-b324-92cb2f73843e' 2026-02-17T00:55:31.323 INFO:tasks.workunit.client.0.trial092.stdout:add osd1 0b8cd378-df63-4db1-b324-92cb2f73843e 2026-02-17T00:55:31.324 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:55:31.331 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCDvJNpBxqUExAAOkeP1NzlkebvC7gVj5L/LQ== 2026-02-17T00:55:31.331 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCDvJNpBxqUExAAOkeP1NzlkebvC7gVj5L/LQ=="}' 2026-02-17T00:55:31.331 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 0b8cd378-df63-4db1-b324-92cb2f73843e -i td/divergent-priors/1/new.json 2026-02-17T00:55:31.438 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:55:31.444 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T00:55:31.445 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCDvJNpBxqUExAAOkeP1NzlkebvC7gVj5L/LQ== --osd-uuid 0b8cd378-df63-4db1-b324-92cb2f73843e 2026-02-17T00:55:31.464 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:31.462+0000 7f8a1be51780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:31.467 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:31.464+0000 7f8a1be51780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:31.468 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:31.465+0000 7f8a1be51780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:31.468 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:31.466+0000 7f8a1be51780 -1 bdev(0x34d0c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T00:55:31.468 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:31.466+0000 7f8a1be51780 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T00:55:31.792 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T00:55:31.792 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:55:31.793 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T00:55:31.793 INFO:tasks.workunit.client.0.trial092.stdout:adding osd1 key to auth repository 2026-02-17T00:55:31.793 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:55:32.115 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T00:55:32.116 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:55:32.116 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:55:32.116 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:55:32.116 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:55:32.116 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:55:32.135 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:32.133+0000 7fd28561e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:32.136 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:32.134+0000 7fd28561e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:32.137 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:32.135+0000 7fd28561e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:32.270 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:32.267+0000 7fd28561e780 -1 Falling back to public interface 2026-02-17T00:55:32.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T00:55:32.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:55:32.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:55:32.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:55:32.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:55:32.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:55:32.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:55:32.347 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:55:32.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:55:32.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:55:32.576 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:32.574+0000 7fd28561e780 -1 osd.1 0 log_to_monitors true 2026-02-17T00:55:32.577 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:55:33.578 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:55:33.579 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:55:33.579 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:55:33.580 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:55:33.580 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:55:33.580 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:55:33.815 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/799948587,v1:127.0.0.1:6811/799948587] [v2:127.0.0.1:6812/799948587,v1:127.0.0.1:6813/799948587] exists,up 0b8cd378-df63-4db1-b324-92cb2f73843e 2026-02-17T00:55:33.819 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:55:33.819 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:55:33.819 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:55:33.819 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-17T00:55:33.819 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 2 2026-02-17T00:55:33.819 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-17T00:55:33.819 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:55:33.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:55:33.821 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:55:33.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:55:33.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:55:33.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:55:33.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:55:33.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:55:33.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:55:33.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T00:55:33.822 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:55:33.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=138b856d-62e1-4fec-be2e-b1915a8a6d08 2026-02-17T00:55:33.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 138b856d-62e1-4fec-be2e-b1915a8a6d08' 2026-02-17T00:55:33.823 INFO:tasks.workunit.client.0.trial092.stdout:add osd2 138b856d-62e1-4fec-be2e-b1915a8a6d08 2026-02-17T00:55:33.823 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:55:33.831 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCFvJNpthxhMRAAFUORdS3Y01Bdz6EviIFzVA== 2026-02-17T00:55:33.831 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCFvJNpthxhMRAAFUORdS3Y01Bdz6EviIFzVA=="}' 2026-02-17T00:55:33.831 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 138b856d-62e1-4fec-be2e-b1915a8a6d08 -i td/divergent-priors/2/new.json 2026-02-17T00:55:34.070 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T00:55:34.077 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T00:55:34.078 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCFvJNpthxhMRAAFUORdS3Y01Bdz6EviIFzVA== --osd-uuid 138b856d-62e1-4fec-be2e-b1915a8a6d08 2026-02-17T00:55:34.098 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:34.096+0000 7fae8f26a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:34.100 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:34.097+0000 7fae8f26a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:34.101 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:34.098+0000 7fae8f26a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:34.101 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:34.099+0000 7fae8f26a780 -1 bdev(0x3c4ac00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T00:55:34.101 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:34.099+0000 7fae8f26a780 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T00:55:34.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T00:55:34.415 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:55:34.415 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T00:55:34.416 INFO:tasks.workunit.client.0.trial092.stdout:adding osd2 key to auth repository 2026-02-17T00:55:34.416 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:55:34.736 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T00:55:34.736 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:55:34.737 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:55:34.737 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:55:34.737 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:55:34.738 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:55:34.755 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:34.753+0000 7f39b2c25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:34.756 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:34.754+0000 7f39b2c25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:34.757 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:34.755+0000 7f39b2c25780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:55:34.890 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:34.887+0000 7f39b2c25780 -1 Falling back to public interface 2026-02-17T00:55:34.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T00:55:34.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:55:34.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:55:34.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:55:34.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:55:34.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:55:34.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:55:34.967 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:55:34.967 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:55:34.968 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:55:35.177 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:55:35.175+0000 7f39b2c25780 -1 osd.2 0 log_to_monitors true 2026-02-17T00:55:35.197 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:55:36.198 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:55:36.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:55:36.199 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:55:36.200 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:55:36.200 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:55:36.200 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:55:36.431 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1739248031,v1:127.0.0.1:6819/1739248031] [v2:127.0.0.1:6820/1739248031,v1:127.0.0.1:6821/1739248031] exists,up 138b856d-62e1-4fec-be2e-b1915a8a6d08 2026-02-17T00:55:36.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:55:36.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:55:36.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:55:36.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:242: TEST_divergent_ec: ceph osd set noout 2026-02-17T00:55:36.747 INFO:tasks.workunit.client.0.trial092.stderr:noout is set 2026-02-17T00:55:36.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noin 2026-02-17T00:55:37.051 INFO:tasks.workunit.client.0.trial092.stderr:noin is set 2026-02-17T00:55:37.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set nodown 2026-02-17T00:55:37.355 INFO:tasks.workunit.client.0.trial092.stderr:nodown is set 2026-02-17T00:55:37.365 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2026-02-17T00:55:37.365 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2521: create_ec_pool: local pool_name=test 2026-02-17T00:55:37.366 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: shift 2026-02-17T00:55:37.366 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: local allow_overwrites=true 2026-02-17T00:55:37.366 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: shift 2026-02-17T00:55:37.366 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2526: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-17T00:55:37.633 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2528: create_ec_pool: create_pool test 1 1 erasure myprofile 2026-02-17T00:55:37.633 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2026-02-17T00:55:38.015 INFO:tasks.workunit.client.0.trial092.stderr:pool 'test' already exists 2026-02-17T00:55:38.022 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T00:55:39.023 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2530: create_ec_pool: '[' true = true ']' 2026-02-17T00:55:39.023 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2026-02-17T00:55:39.339 INFO:tasks.workunit.client.0.trial092.stderr:set pool 1 allow_ec_overwrites to true 2026-02-17T00:55:39.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2534: create_ec_pool: wait_for_clean 2026-02-17T00:55:39.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:55:39.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:55:39.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:55:39.348 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T00:55:39.349 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:55:39.349 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:55:39.349 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:55:39.349 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:55:39.349 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:55:39.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T00:55:39.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:55:39.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:55:39.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:55:39.436 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:55:39.436 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:55:39.668 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:55:39.668 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:55:39.668 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:55:39.668 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:55:39.668 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:39.669 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:55:39.736 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-17T00:55:39.736 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-17T00:55:39.736 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484' 2026-02-17T00:55:39.737 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:39.737 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:55:39.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705669 2026-02-17T00:55:39.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705669 2026-02-17T00:55:39.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-38654705669' 2026-02-17T00:55:39.802 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:39.803 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:55:39.869 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542147 2026-02-17T00:55:39.869 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542147 2026-02-17T00:55:39.869 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836484 1-38654705669 2-60129542147' 2026-02-17T00:55:39.870 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:39.870 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836484 2026-02-17T00:55:39.870 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:39.871 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:55:39.871 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-17T00:55:39.871 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:39.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836484 2026-02-17T00:55:39.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-17T00:55:39.873 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836484 2026-02-17T00:55:39.873 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:55:40.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T00:55:40.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:55:41.112 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:55:41.112 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:55:41.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-17T00:55:41.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:55:42.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T00:55:42.350 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:55:42.583 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836484 -lt 21474836484 2026-02-17T00:55:42.583 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:42.583 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705669 2026-02-17T00:55:42.583 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:42.584 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:55:42.585 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705669 2026-02-17T00:55:42.585 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:42.586 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705669 2026-02-17T00:55:42.586 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T00:55:42.586 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 38654705669 2026-02-17T00:55:42.586 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:55:42.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-17T00:55:42.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:42.820 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542147 2026-02-17T00:55:42.821 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:42.821 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:55:42.821 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542147 2026-02-17T00:55:42.822 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:42.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542147 2026-02-17T00:55:42.823 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T00:55:42.823 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 60129542147 2026-02-17T00:55:42.823 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:55:43.053 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542148 -lt 60129542147 2026-02-17T00:55:43.053 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:55:43.054 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:55:43.054 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:55:43.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:55:43.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:55:43.375 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:55:43.375 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:55:43.375 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:55:43.375 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:55:43.375 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:55:43.375 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:55:43.604 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T00:55:43.605 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:55:43.605 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:55:43.605 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:55:43.923 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T00:55:43.923 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T00:55:43.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T00:55:43.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: return 0 2026-02-17T00:55:43.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:247: TEST_divergent_ec: flush_pg_stats 2026-02-17T00:55:43.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:55:43.924 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:55:44.153 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:55:44.153 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:55:44.153 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:55:44.154 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:55:44.154 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:44.154 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:55:44.221 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-17T00:55:44.221 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-17T00:55:44.221 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T00:55:44.221 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:44.221 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:55:44.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705672 2026-02-17T00:55:44.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705672 2026-02-17T00:55:44.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705672' 2026-02-17T00:55:44.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:44.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:55:44.358 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542150 2026-02-17T00:55:44.358 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542150 2026-02-17T00:55:44.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836487 1-38654705672 2-60129542150' 2026-02-17T00:55:44.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:44.359 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836487 2026-02-17T00:55:44.359 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:44.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:55:44.360 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-17T00:55:44.360 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:44.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836487 2026-02-17T00:55:44.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T00:55:44.361 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836487 2026-02-17T00:55:44.361 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:55:44.590 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T00:55:44.591 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:55:45.591 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:55:45.592 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:55:45.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T00:55:45.823 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:45.823 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705672 2026-02-17T00:55:45.824 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:45.824 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:55:45.825 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705672 2026-02-17T00:55:45.825 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:45.826 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705672 2026-02-17T00:55:45.826 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-17T00:55:45.826 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 38654705672 2026-02-17T00:55:45.827 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:55:46.057 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-17T00:55:46.057 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:46.058 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542150 2026-02-17T00:55:46.058 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:46.059 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:55:46.060 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542150 2026-02-17T00:55:46.060 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:46.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542150 2026-02-17T00:55:46.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T00:55:46.061 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 60129542150 2026-02-17T00:55:46.061 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:55:46.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T00:55:46.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: wait_for_clean 2026-02-17T00:55:46.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:55:46.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:55:46.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:55:46.290 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T00:55:46.291 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:55:46.291 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:55:46.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:55:46.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:55:46.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:55:46.377 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T00:55:46.377 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:55:46.377 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:55:46.377 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:55:46.377 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:55:46.377 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:55:46.605 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:55:46.605 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:55:46.605 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:55:46.605 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:55:46.606 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:46.606 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:55:46.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-17T00:55:46.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-17T00:55:46.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T00:55:46.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:46.674 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:55:46.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-17T00:55:46.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-17T00:55:46.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705674' 2026-02-17T00:55:46.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:46.741 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:55:46.807 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542153 2026-02-17T00:55:46.807 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542153 2026-02-17T00:55:46.807 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836490 1-38654705674 2-60129542153' 2026-02-17T00:55:46.807 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:46.807 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836490 2026-02-17T00:55:46.808 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:46.808 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:55:46.809 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-17T00:55:46.809 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:46.810 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836490 2026-02-17T00:55:46.810 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T00:55:46.811 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836490 2026-02-17T00:55:46.811 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:55:47.040 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836487 -lt 21474836490 2026-02-17T00:55:47.040 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:55:48.041 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:55:48.041 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:55:48.276 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-17T00:55:48.276 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:48.277 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705674 2026-02-17T00:55:48.277 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:48.277 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:55:48.278 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-17T00:55:48.278 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:48.280 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705674 2026-02-17T00:55:48.280 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-17T00:55:48.280 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 38654705674 2026-02-17T00:55:48.280 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:55:48.508 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-17T00:55:48.509 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:48.509 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542153 2026-02-17T00:55:48.509 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:48.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:55:48.510 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542153 2026-02-17T00:55:48.511 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:48.512 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542153 2026-02-17T00:55:48.512 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T00:55:48.512 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 60129542153 2026-02-17T00:55:48.512 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:55:48.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T00:55:48.742 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:55:48.742 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:55:48.742 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:55:49.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:55:49.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:55:49.060 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:55:49.060 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:55:49.060 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:55:49.060 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:55:49.060 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:55:49.061 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:55:49.286 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T00:55:49.287 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:55:49.287 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:55:49.287 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:55:49.610 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T00:55:49.610 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T00:55:49.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T00:55:49.611 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: ceph pg dump pgs --format=json 2026-02-17T00:55:49.611 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2026-02-17T00:55:49.826 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:55:49.834 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: local divergent=1 2026-02-17T00:55:49.834 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2026-02-17T00:55:49.834 INFO:tasks.workunit.client.0.trial092.stdout:primary and soon to be divergent is 1 2026-02-17T00:55:49.834 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:55:50.054 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:55:50.054 INFO:tasks.workunit.client.0.trial092.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T00:55:38.531901+0000 0'0 28:16 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T01:53:52.881848+0000 0 0 2026-02-17T00:55:50.054 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:55:50.054 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:55:50.054 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: local non_divergent= 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 0 = 1 ']' 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0' 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 1 = 1 ']' 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: continue 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 2 = 1 ']' 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0 2' 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:263: TEST_divergent_ec: echo 'writing initial objects' 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stdout:writing initial objects 2026-02-17T00:55:50.061 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: seq 1 100 2026-02-17T00:55:50.062 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.062 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_1 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.083 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_2 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_3 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.120 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.120 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_5 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_6 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.176 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.176 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_7 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.194 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.194 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_8 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_9 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.230 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.231 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_10 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.250 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.250 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_11 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_12 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.288 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.288 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_13 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.306 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.307 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_14 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.324 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.324 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_15 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.343 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.343 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_16 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.361 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_17 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.380 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.380 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_18 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.399 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.399 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_19 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.417 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.417 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_20 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.436 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.436 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_21 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_22 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.473 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.473 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_23 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.491 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.491 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_24 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.509 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_25 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.529 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.529 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_26 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.548 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.548 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_27 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.567 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.567 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_28 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.585 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.586 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_29 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.604 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.604 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_30 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.622 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.622 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_31 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_32 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.659 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.659 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_33 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.678 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.679 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_34 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_35 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_36 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.733 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.734 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_37 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.753 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.753 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_38 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_39 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.789 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.789 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_40 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.808 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.809 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_41 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.827 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.827 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_42 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.846 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.846 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_43 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.865 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.865 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_44 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.884 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.884 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_45 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_46 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_47 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_48 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.959 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.959 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_49 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.978 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_50 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:50.996 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:50.996 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_51 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_52 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.034 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.034 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_53 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.053 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.053 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_54 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.072 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.072 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_55 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.091 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.091 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_56 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_57 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.128 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.128 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_58 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.147 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.147 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_59 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.167 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_60 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_61 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.205 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.205 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_62 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.224 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.224 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_63 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.243 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.243 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_64 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.261 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.262 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_65 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.279 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.280 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_66 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_67 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.317 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.317 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_68 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.335 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_69 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.354 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.354 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_70 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.374 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_71 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_72 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_73 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.431 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.431 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_74 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_75 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.469 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.469 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_76 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.487 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.488 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_77 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.506 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.506 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_78 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.525 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.526 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_79 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.545 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.546 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_80 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.564 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.564 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_81 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.583 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.584 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_82 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.602 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.603 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_83 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.621 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.621 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_84 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_85 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.659 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.659 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_86 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.678 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_87 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.698 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_88 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_89 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.735 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.735 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_90 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.753 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.753 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_91 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.772 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.772 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_92 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.791 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.791 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_93 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.810 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.811 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_94 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.828 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.829 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_95 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.847 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.847 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_96 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.865 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.866 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_97 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.884 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.884 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_98 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T00:55:51.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:51.942 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T00:55:51.942 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: wait_for_clean 2026-02-17T00:55:51.942 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:55:51.942 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:55:51.942 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:55:51.942 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T00:55:51.943 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:55:51.943 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:55:51.943 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:55:51.944 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:55:51.944 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:55:51.996 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T00:55:51.996 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:55:51.996 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:55:51.996 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:55:51.996 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:55:51.997 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:55:52.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:55:52.225 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:55:52.225 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:55:52.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:55:52.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:52.225 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:55:52.294 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836493 2026-02-17T00:55:52.294 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836493 2026-02-17T00:55:52.294 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493' 2026-02-17T00:55:52.294 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:52.294 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:55:52.358 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705677 2026-02-17T00:55:52.358 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705677 2026-02-17T00:55:52.358 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-38654705677' 2026-02-17T00:55:52.358 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:55:52.359 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:55:52.430 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=60129542156 2026-02-17T00:55:52.430 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 60129542156 2026-02-17T00:55:52.430 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-21474836493 1-38654705677 2-60129542156' 2026-02-17T00:55:52.431 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:52.431 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-21474836493 2026-02-17T00:55:52.431 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:52.431 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:55:52.432 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836493 2026-02-17T00:55:52.432 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:52.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=21474836493 2026-02-17T00:55:52.433 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-17T00:55:52.433 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 21474836493 2026-02-17T00:55:52.433 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:55:52.670 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836490 -lt 21474836493 2026-02-17T00:55:52.670 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:55:53.671 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:55:53.672 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:55:53.904 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-17T00:55:53.904 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:53.905 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-38654705677 2026-02-17T00:55:53.905 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:53.905 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:55:53.906 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:53.906 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705677 2026-02-17T00:55:53.907 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=38654705677 2026-02-17T00:55:53.907 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 38654705677 2026-02-17T00:55:53.908 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 38654705677' 2026-02-17T00:55:53.908 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:55:54.138 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 38654705677 -lt 38654705677 2026-02-17T00:55:54.138 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:55:54.138 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-60129542156 2026-02-17T00:55:54.139 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:55:54.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:55:54.140 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-60129542156 2026-02-17T00:55:54.140 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:55:54.141 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=60129542156 2026-02-17T00:55:54.141 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 60129542156' 2026-02-17T00:55:54.141 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 60129542156 2026-02-17T00:55:54.141 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:55:54.380 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 60129542156 -lt 60129542156 2026-02-17T00:55:54.380 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:55:54.381 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:55:54.381 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:55:54.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:55:54.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:55:54.714 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:55:54.714 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:55:54.714 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:55:54.714 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:55:54.714 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:55:54.714 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:55:54.939 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T00:55:54.940 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:55:54.940 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:55:54.940 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:55:55.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T00:55:55.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T00:55:55.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T00:55:55.265 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: get_pg test existing_1 2026-02-17T00:55:55.265 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-17T00:55:55.265 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-17T00:55:55.265 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-17T00:55:55.265 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-17T00:55:55.499 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: local pgid=1.0 2026-02-17T00:55:55.500 INFO:tasks.workunit.client.0.trial092.stdout:blackholing osds 0 2 2026-02-17T00:55:55.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:275: TEST_divergent_ec: echo 'blackholing osds 0 2' 2026-02-17T00:55:55.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:55:55.716 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:55:55.717 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-17T00:55:38.531901+0000 28'100 28:116 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T01:53:52.881848+0000 0 0 2026-02-17T00:55:55.717 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:55:55.717 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:55:55.717 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:55:55.724 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:55:55.725 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.0 2026-02-17T00:55:55.725 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T00:55:55.725 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T00:55:55.725 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:55:55.725 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:55.725 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:55.725 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.0.asok 2026-02-17T00:55:55.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T00:55:55.726 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T00:55:55.769 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:55:55.769 INFO:tasks.workunit.client.0.trial092.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T00:55:55.769 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:55:55.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:55:55.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.2 2026-02-17T00:55:55.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T00:55:55.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T00:55:55.775 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:55:55.775 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:55:55.775 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:55:55.775 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.2.asok 2026-02-17T00:55:55.775 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T00:55:55.775 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T00:55:55.817 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:55:55.817 INFO:tasks.workunit.client.0.trial092.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T00:55:55.817 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:55:55.820 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:283: TEST_divergent_ec: echo 'writing divergent object' 2026-02-17T00:55:55.821 INFO:tasks.workunit.client.0.trial092.stdout:writing divergent object 2026-02-17T00:55:55.821 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: sleep 1 2026-02-17T00:55:55.821 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.1QlqPjU3qX 2026-02-17T00:55:56.822 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test mksnap snap1 2026-02-17T00:55:56.823 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:55:56.893 INFO:tasks.workunit.client.0.trial092.stdout:created pool test snap snap1 2026-02-17T00:55:56.895 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: sleep 10 2026-02-17T00:55:56.895 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: expr 100 - 1 2026-02-17T00:55:56.896 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.GRJdY5VaAe 2026-02-17T00:56:06.896 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: killall -9 rados 2026-02-17T00:56:06.926 INFO:tasks.workunit.client.0.trial092.stderr:rados: no process found 2026-02-17T00:56:06.926 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:293: TEST_divergent_ec: echo 'killing all the osds' 2026-02-17T00:56:06.926 INFO:tasks.workunit.client.0.trial092.stdout:killing all the osds 2026-02-17T00:56:06.927 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:56:07.144 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:56:07.144 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 active+clean 2026-02-17T00:55:38.531901+0000 29'104 29:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:09:00.715277+0000 0 0 2026-02-17T00:56:07.144 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:56:07.144 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:56:07.145 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:56:07.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2026-02-17T00:56:07.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:56:07.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:56:07.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:56:07.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:56:07.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:56:07.259 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:56:07.259 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-17T00:56:07.259 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.0 2026-02-17T00:56:07.590 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already down. 2026-02-17T00:56:07.598 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-17T00:56:07.598 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.1 2026-02-17T00:56:07.879 INFO:tasks.workunit.client.0.trial092.stderr:osd.1 is already down. 2026-02-17T00:56:07.887 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-17T00:56:07.887 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.2 2026-02-17T00:56:08.168 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already down. 2026-02-17T00:56:08.176 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:56:08.176 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.0 2026-02-17T00:56:08.460 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already out. 2026-02-17T00:56:08.468 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:56:08.468 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.2 2026-02-17T00:56:08.748 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already out. 2026-02-17T00:56:08.755 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:306: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2026-02-17T00:56:08.755 INFO:tasks.workunit.client.0.trial092.stdout:bringing up non_divergent 0 2 2026-02-17T00:56:08.756 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:56:08.973 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:56:08.974 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 stale+active+clean 2026-02-17T00:55:38.531901+0000 29'104 29:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T08:09:00.715277+0000 0 0 2026-02-17T00:56:08.974 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:56:08.974 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:56:08.974 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:56:08.984 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:56:08.984 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-17T00:56:08.984 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:56:08.984 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:56:08.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T00:56:08.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:56:08.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T00:56:08.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:56:08.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:56:08.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:56:08.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:56:08.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T00:56:08.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T00:56:08.986 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:56:08.986 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:56:08.986 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:56:08.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:56:08.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:56:08.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:56:08.986 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:56:08.986 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:56:08.986 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:56:08.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:56:08.986 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:56:08.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:56:08.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:56:08.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:56:08.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:56:08.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:56:08.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:56:08.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:56:08.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:56:08.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:56:08.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T00:56:08.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T00:56:08.988 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:56:08.989 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:56:08.989 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T00:56:08.989 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T00:56:08.989 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:56:08.989 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:56:08.990 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:56:09.003 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:09.000+0000 7fb8d5612780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:09.004 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:09.001+0000 7fb8d5612780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:09.005 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:09.002+0000 7fb8d5612780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:09.147 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:09.145+0000 7fb8d5612780 -1 Falling back to public interface 2026-02-17T00:56:09.219 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T00:56:09.219 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:56:09.219 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:56:09.219 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:56:09.219 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:56:09.219 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:56:09.219 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:56:09.220 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:56:09.220 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:56:09.220 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:56:09.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:56:09.532 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:09.530+0000 7fb8d5612780 -1 osd.0 28 log_to_monitors true 2026-02-17T00:56:10.453 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:56:10.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:56:10.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:56:10.454 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:56:10.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:56:10.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:56:10.687 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6800/2999222288,v1:127.0.0.1:6801/2999222288] [v2:127.0.0.1:6802/2999222288,v1:127.0.0.1:6803/2999222288] exists,up b75a4676-94b7-4664-91a3-24464591fad4 2026-02-17T00:56:10.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:56:10.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:56:10.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:56:10.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:56:10.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-17T00:56:10.688 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:56:10.689 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:56:10.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:56:10.691 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:56:10.691 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:56:10.691 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:56:10.691 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:56:10.692 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:56:10.692 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:56:10.692 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:56:10.692 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:56:10.692 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:56:10.692 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:56:10.692 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T00:56:10.692 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T00:56:10.693 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:56:10.693 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:56:10.694 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T00:56:10.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T00:56:10.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:56:10.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:56:10.694 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:56:10.709 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:10.707+0000 7fc2cac4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:10.711 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:10.708+0000 7fc2cac4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:10.711 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:10.709+0000 7fc2cac4b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:10.837 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:10.835+0000 7fc2cac4b780 -1 Falling back to public interface 2026-02-17T00:56:10.923 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T00:56:10.923 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:56:10.923 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:56:10.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:56:10.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:56:10.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:56:10.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:56:10.924 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:56:10.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:56:10.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:56:11.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:56:11.258 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:11.256+0000 7fc2cac4b780 -1 osd.2 28 log_to_monitors true 2026-02-17T00:56:12.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:56:12.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:56:12.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:56:12.161 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:56:12.162 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:56:12.162 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:56:12.395 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up out weight 0 up_from 39 up_thru 0 down_at 32 last_clean_interval [14,28) [v2:127.0.0.1:6810/1431357102,v1:127.0.0.1:6811/1431357102] [v2:127.0.0.1:6812/1431357102,v1:127.0.0.1:6813/1431357102] exists,up 138b856d-62e1-4fec-be2e-b1915a8a6d08 2026-02-17T00:56:12.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:56:12.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:56:12.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:56:12.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:56:12.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.0 2026-02-17T00:56:12.641 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already in. 2026-02-17T00:56:12.648 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:56:12.648 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.2 2026-02-17T00:56:12.946 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already in. 2026-02-17T00:56:12.955 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:317: TEST_divergent_ec: sleep 5 2026-02-17T00:56:17.956 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: expr 2 + 2 2026-02-17T00:56:17.958 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: objname=existing_4 2026-02-17T00:56:17.958 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2026-02-17T00:56:17.958 INFO:tasks.workunit.client.0.trial092.stdout:writing non-divergent object existing_4 2026-02-17T00:56:17.959 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:56:18.177 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:56:18.177 INFO:tasks.workunit.client.0.trial092.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded+wait 2026-02-17T00:56:12.980949+0000 28'100 44:134 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T10:04:45.623054+0000 0 0 2026-02-17T00:56:18.177 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:56:18.178 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:56:18.178 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:56:18.184 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.1QlqPjU3qX 2026-02-17T00:56:28.782 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rm -f /tmp/tmp.1QlqPjU3qX 2026-02-17T00:56:28.783 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T00:56:28.783 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2026-02-17T00:56:28.783 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:56:28.783 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:56:28.783 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:56:28.783 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T00:56:28.784 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:56:28.784 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:56:28.785 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:56:28.785 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:56:28.785 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:56:28.839 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T00:56:28.839 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:56:28.839 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:56:28.839 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:56:28.839 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:56:28.839 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:56:29.070 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:56:29.071 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:56:29.071 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:56:29.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:56:29.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:56:29.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:56:29.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822662 2026-02-17T00:56:29.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822662 2026-02-17T00:56:29.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822662' 2026-02-17T00:56:29.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:56:29.139 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:56:29.188 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T00:56:29.188 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T00:56:29.188 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T00:56:29.188 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T00:56:29.188 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:56:29.188 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:56:29.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=167503724550 2026-02-17T00:56:29.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 167503724550 2026-02-17T00:56:29.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-154618822662 2-167503724550' 2026-02-17T00:56:29.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:56:29.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-154618822662 2026-02-17T00:56:29.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:56:29.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:56:29.258 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-154618822662 2026-02-17T00:56:29.258 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:56:29.259 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=154618822662 2026-02-17T00:56:29.259 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 154618822662' 2026-02-17T00:56:29.260 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 154618822662 2026-02-17T00:56:29.260 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:56:29.495 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 154618822662 -lt 154618822662 2026-02-17T00:56:29.495 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:56:29.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-167503724550 2026-02-17T00:56:29.496 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:56:29.496 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:56:29.497 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-167503724550 2026-02-17T00:56:29.497 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:56:29.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=167503724550 2026-02-17T00:56:29.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 167503724550' 2026-02-17T00:56:29.498 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 167503724550 2026-02-17T00:56:29.499 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:56:29.730 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 167503724550 -lt 167503724550 2026-02-17T00:56:29.731 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:56:29.731 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:56:29.731 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:56:30.048 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:56:30.049 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:56:30.049 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:56:30.049 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:56:30.049 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:56:30.049 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:56:30.049 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:56:30.049 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:56:30.273 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:56:30.273 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:56:30.273 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:56:30.273 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:56:30.590 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:56:30.590 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T00:56:30.590 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T00:56:30.590 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T00:56:30.590 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:56:30.590 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T00:56:30.691 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:56:30.691 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:56:30.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:56:30.692 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:56:30.692 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:56:30.692 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:56:30.692 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:56:30.692 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:56:30.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:56:30.922 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:56:30.922 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:56:30.922 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:56:31.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:56:31.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:56:31.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:56:31.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:56:31.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:56:31.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:56:31.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:56:31.242 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:56:31.242 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:56:31.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:56:31.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:56:31.562 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T00:56:31.562 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:56:31.562 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T00:56:31.762 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:56:31.762 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:56:31.763 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:56:31.763 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:56:31.764 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:56:31.764 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:56:31.764 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:56:31.764 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:56:31.993 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:56:31.994 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:56:31.994 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:56:31.994 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:56:32.319 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:56:32.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:56:32.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:56:32.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:56:32.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:56:32.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:56:32.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:56:32.320 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:56:32.320 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:56:32.648 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:56:32.648 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:56:32.648 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T00:56:32.648 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:56:32.648 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T00:56:33.048 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:56:33.048 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:56:33.050 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:56:33.050 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:56:33.050 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:56:33.050 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:56:33.050 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:56:33.050 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:56:33.280 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:56:33.280 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:56:33.281 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:56:33.281 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:56:33.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:56:33.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:56:33.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:56:33.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:56:33.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:56:33.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:56:33.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:56:33.602 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:56:33.602 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:56:33.920 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:56:33.920 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:56:33.920 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T00:56:33.920 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:56:33.920 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T00:56:34.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:56:34.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:56:34.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:56:34.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:56:34.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:56:34.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:56:34.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:56:34.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:56:34.952 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:56:34.953 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:56:34.953 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:56:34.954 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:56:35.287 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:56:35.287 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:56:35.288 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:56:35.288 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:56:35.288 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:56:35.288 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:56:35.288 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:56:35.288 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:56:35.288 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:56:35.607 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:56:35.607 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:56:35.607 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T00:56:35.607 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:56:35.607 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T00:56:37.208 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:56:37.208 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:56:37.209 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:56:37.209 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:56:37.209 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:56:37.209 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:56:37.209 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:56:37.209 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:56:37.447 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:56:37.448 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:56:37.448 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:56:37.448 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:56:37.768 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:56:37.769 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:56:37.769 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:56:37.769 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:56:37.769 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:56:37.769 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:56:37.769 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:56:37.769 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:56:37.769 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:56:38.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:56:38.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:56:38.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T00:56:38.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:56:38.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T00:56:41.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:56:41.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:56:41.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:56:41.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:56:41.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:56:41.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:56:41.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:56:41.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:56:41.520 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:56:41.520 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:56:41.520 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:56:41.521 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:56:41.841 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:56:41.841 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:56:41.841 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:56:41.841 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:56:41.841 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:56:41.841 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:56:41.841 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:56:41.841 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:56:41.842 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:56:42.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:56:42.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:56:42.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T00:56:42.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:56:42.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T00:56:48.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:56:48.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:56:48.563 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:56:48.563 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:56:48.563 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:56:48.563 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:56:48.563 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:56:48.564 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:56:48.792 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:56:48.792 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:56:48.793 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:56:48.793 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:56:49.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:56:49.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:56:49.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:56:49.110 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:56:49.110 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:56:49.110 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:56:49.110 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:56:49.110 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:56:49.110 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:56:49.447 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:56:49.447 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:56:49.447 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T00:56:49.447 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:56:49.447 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T00:56:56.748 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:56:56.748 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:56:56.749 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:56:56.749 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:56:56.749 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:56:56.750 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:56:56.750 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:56:56.750 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:56:56.981 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:56:56.981 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:56:56.982 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:56:56.982 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:56:57.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:56:57.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:56:57.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:56:57.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:56:57.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:56:57.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:56:57.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:56:57.323 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:56:57.323 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:56:57.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:56:57.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:56:57.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T00:56:57.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T00:56:57.950 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:56:57.950 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_fingerprint": "8334ef58-6060-4be8-94c2-67d68a8d3a27", 2026-02-17T00:56:57.950 INFO:tasks.workunit.client.0.trial092.stdout: "version": "20.3.0-5225-g03ef619e", 2026-02-17T00:56:57.951 INFO:tasks.workunit.client.0.trial092.stdout: "commit": "03ef619e79a56cd363b087a5c6f19a1a09b49040", 2026-02-17T00:56:57.951 INFO:tasks.workunit.client.0.trial092.stdout: "timestamp": "2026-02-17T00:56:57.949297+0000", 2026-02-17T00:56:57.951 INFO:tasks.workunit.client.0.trial092.stdout: "tag": "", 2026-02-17T00:56:57.951 INFO:tasks.workunit.client.0.trial092.stdout: "health": { 2026-02-17T00:56:57.951 INFO:tasks.workunit.client.0.trial092.stdout: "status": "HEALTH_WARN", 2026-02-17T00:56:57.951 INFO:tasks.workunit.client.0.trial092.stdout: "checks": { 2026-02-17T00:56:57.951 INFO:tasks.workunit.client.0.trial092.stdout: "OSDMAP_FLAGS": { 2026-02-17T00:56:57.951 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:56:57.951 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:56:57.951 INFO:tasks.workunit.client.0.trial092.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T00:56:57.952 INFO:tasks.workunit.client.0.trial092.stdout: "count": 17 2026-02-17T00:56:57.952 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.952 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [], 2026-02-17T00:56:57.952 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:56:57.952 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.952 INFO:tasks.workunit.client.0.trial092.stdout: "OSD_DOWN": { 2026-02-17T00:56:57.952 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:56:57.952 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:56:57.952 INFO:tasks.workunit.client.0.trial092.stdout: "message": "1 osds down", 2026-02-17T00:56:57.952 INFO:tasks.workunit.client.0.trial092.stdout: "count": 1 2026-02-17T00:56:57.952 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.953 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:56:57.953 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.953 INFO:tasks.workunit.client.0.trial092.stdout: "message": "osd.1 (root=default,host=trial092) is down" 2026-02-17T00:56:57.953 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.953 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:57.953 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:56:57.953 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.953 INFO:tasks.workunit.client.0.trial092.stdout: "PG_DEGRADED": { 2026-02-17T00:56:57.953 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:56:57.953 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:56:57.954 INFO:tasks.workunit.client.0.trial092.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-17T00:56:57.954 INFO:tasks.workunit.client.0.trial092.stdout: "count": 1 2026-02-17T00:56:57.954 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.954 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:56:57.954 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.954 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-17T00:56:57.954 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.954 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:57.954 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:56:57.954 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.955 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.955 INFO:tasks.workunit.client.0.trial092.stdout: "mutes": [] 2026-02-17T00:56:57.955 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.955 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_first_committed": 1, 2026-02-17T00:56:57.955 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_last_committed": 1, 2026-02-17T00:56:57.955 INFO:tasks.workunit.client.0.trial092.stdout: "monmap": { 2026-02-17T00:56:57.955 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:56:57.955 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:56:57.955 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:55:29.116872Z", 2026-02-17T00:56:57.955 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:55:29.116872Z", 2026-02-17T00:56:57.955 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release": 20, 2026-02-17T00:56:57.956 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release_name": "tentacle", 2026-02-17T00:56:57.956 INFO:tasks.workunit.client.0.trial092.stdout: "election_strategy": 1, 2026-02-17T00:56:57.956 INFO:tasks.workunit.client.0.trial092.stdout: "disallowed_leaders": "", 2026-02-17T00:56:57.956 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": false, 2026-02-17T00:56:57.956 INFO:tasks.workunit.client.0.trial092.stdout: "tiebreaker_mon": "", 2026-02-17T00:56:57.956 INFO:tasks.workunit.client.0.trial092.stdout: "removed_ranks": "", 2026-02-17T00:56:57.956 INFO:tasks.workunit.client.0.trial092.stdout: "features": { 2026-02-17T00:56:57.956 INFO:tasks.workunit.client.0.trial092.stdout: "persistent": [ 2026-02-17T00:56:57.956 INFO:tasks.workunit.client.0.trial092.stdout: "kraken", 2026-02-17T00:56:57.956 INFO:tasks.workunit.client.0.trial092.stdout: "luminous", 2026-02-17T00:56:57.956 INFO:tasks.workunit.client.0.trial092.stdout: "mimic", 2026-02-17T00:56:57.957 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap-prune", 2026-02-17T00:56:57.957 INFO:tasks.workunit.client.0.trial092.stdout: "nautilus", 2026-02-17T00:56:57.957 INFO:tasks.workunit.client.0.trial092.stdout: "octopus", 2026-02-17T00:56:57.957 INFO:tasks.workunit.client.0.trial092.stdout: "pacific", 2026-02-17T00:56:57.957 INFO:tasks.workunit.client.0.trial092.stdout: "elector-pinging", 2026-02-17T00:56:57.957 INFO:tasks.workunit.client.0.trial092.stdout: "quincy", 2026-02-17T00:56:57.957 INFO:tasks.workunit.client.0.trial092.stdout: "reef", 2026-02-17T00:56:57.957 INFO:tasks.workunit.client.0.trial092.stdout: "squid", 2026-02-17T00:56:57.957 INFO:tasks.workunit.client.0.trial092.stdout: "tentacle", 2026-02-17T00:56:57.957 INFO:tasks.workunit.client.0.trial092.stdout: "nvmeof_beacon_diff" 2026-02-17T00:56:57.957 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: "optional": [] 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: "mons": [ 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: "rank": 0, 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: "name": "a", 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115", 2026-02-17T00:56:57.958 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 0 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: "priority": 0, 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 0, 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: "time_added": "2026-02-17T00:55:29:116868+0000", 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: "crush_location": [] 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.959 INFO:tasks.workunit.client.0.trial092.stdout: "quorum": [ 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: 0 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap": { 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 44, 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:55:29.151863+0000", 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:56:12.978871+0000", 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: "last_up_change": "2026-02-17T00:56:11.438683+0000", 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: "last_in_change": "2026-02-17T00:56:12.878342+0000", 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: "flags_num": 5800384, 2026-02-17T00:56:57.960 INFO:tasks.workunit.client.0.trial092.stdout: "flags_set": [ 2026-02-17T00:56:57.961 INFO:tasks.workunit.client.0.trial092.stdout: "nodown", 2026-02-17T00:56:57.961 INFO:tasks.workunit.client.0.trial092.stdout: "noin", 2026-02-17T00:56:57.961 INFO:tasks.workunit.client.0.trial092.stdout: "noout", 2026-02-17T00:56:57.961 INFO:tasks.workunit.client.0.trial092.stdout: "pglog_hardlimit", 2026-02-17T00:56:57.961 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snapdirs", 2026-02-17T00:56:57.961 INFO:tasks.workunit.client.0.trial092.stdout: "recovery_deletes", 2026-02-17T00:56:57.961 INFO:tasks.workunit.client.0.trial092.stdout: "sortbitwise" 2026-02-17T00:56:57.961 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:57.961 INFO:tasks.workunit.client.0.trial092.stdout: "crush_version": 10, 2026-02-17T00:56:57.961 INFO:tasks.workunit.client.0.trial092.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T00:56:57.961 INFO:tasks.workunit.client.0.trial092.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_snapshot": "", 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: "pool_max": 1, 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: "max_osd": 3, 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: "require_min_compat_client": "luminous", 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: "min_compat_client": "jewel", 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: "require_osd_release": "tentacle", 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: "allow_crimson": false, 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: "pools": [ 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:56:57.962 INFO:tasks.workunit.client.0.trial092.stdout: "pool_name": "test", 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "create_time": "2026-02-17T00:55:37.852956+0000", 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "flags": 16389, 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "type": 3, 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "size": 3, 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "min_size": 2, 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "crush_rule": 1, 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_count": 0, 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_target": 0, 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T00:56:57.963 INFO:tasks.workunit.client.0.trial092.stdout: "is_stretch_pool": false, 2026-02-17T00:56:57.964 INFO:tasks.workunit.client.0.trial092.stdout: "object_hash": 2, 2026-02-17T00:56:57.964 INFO:tasks.workunit.client.0.trial092.stdout: "pg_autoscale_mode": "off", 2026-02-17T00:56:57.964 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num": 1, 2026-02-17T00:56:57.964 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num": 1, 2026-02-17T00:56:57.964 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num_target": 1, 2026-02-17T00:56:57.964 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_target": 1, 2026-02-17T00:56:57.964 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_pending": 1, 2026-02-17T00:56:57.964 INFO:tasks.workunit.client.0.trial092.stdout: "last_pg_merge_meta": { 2026-02-17T00:56:57.964 INFO:tasks.workunit.client.0.trial092.stdout: "source_pgid": "0.0", 2026-02-17T00:56:57.964 INFO:tasks.workunit.client.0.trial092.stdout: "ready_epoch": 0, 2026-02-17T00:56:57.964 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_started": 0, 2026-02-17T00:56:57.965 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": 0, 2026-02-17T00:56:57.965 INFO:tasks.workunit.client.0.trial092.stdout: "source_version": "0'0", 2026-02-17T00:56:57.965 INFO:tasks.workunit.client.0.trial092.stdout: "target_version": "0'0" 2026-02-17T00:56:57.965 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.965 INFO:tasks.workunit.client.0.trial092.stdout: "last_change": "29", 2026-02-17T00:56:57.965 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend": "0", 2026-02-17T00:56:57.965 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T00:56:57.965 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T00:56:57.965 INFO:tasks.workunit.client.0.trial092.stdout: "auid": 0, 2026-02-17T00:56:57.965 INFO:tasks.workunit.client.0.trial092.stdout: "snap_mode": "pool", 2026-02-17T00:56:57.966 INFO:tasks.workunit.client.0.trial092.stdout: "snap_seq": 1, 2026-02-17T00:56:57.966 INFO:tasks.workunit.client.0.trial092.stdout: "snap_epoch": 29, 2026-02-17T00:56:57.966 INFO:tasks.workunit.client.0.trial092.stdout: "pool_snaps": [ 2026-02-17T00:56:57.966 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.966 INFO:tasks.workunit.client.0.trial092.stdout: "snapid": 1, 2026-02-17T00:56:57.966 INFO:tasks.workunit.client.0.trial092.stdout: "stamp": "2026-02-17T00:55:56.839934+0000", 2026-02-17T00:56:57.966 INFO:tasks.workunit.client.0.trial092.stdout: "name": "snap1" 2026-02-17T00:56:57.966 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.967 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:57.967 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps": "[]", 2026-02-17T00:56:57.967 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_bytes": 0, 2026-02-17T00:56:57.967 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_objects": 0, 2026-02-17T00:56:57.967 INFO:tasks.workunit.client.0.trial092.stdout: "tiers": [], 2026-02-17T00:56:57.967 INFO:tasks.workunit.client.0.trial092.stdout: "tier_of": -1, 2026-02-17T00:56:57.967 INFO:tasks.workunit.client.0.trial092.stdout: "read_tier": -1, 2026-02-17T00:56:57.967 INFO:tasks.workunit.client.0.trial092.stdout: "write_tier": -1, 2026-02-17T00:56:57.967 INFO:tasks.workunit.client.0.trial092.stdout: "cache_mode": "none", 2026-02-17T00:56:57.967 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_bytes": 0, 2026-02-17T00:56:57.967 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_objects": 0, 2026-02-17T00:56:57.968 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T00:56:57.968 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T00:56:57.968 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T00:56:57.968 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_flush_age": 0, 2026-02-17T00:56:57.968 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_evict_age": 0, 2026-02-17T00:56:57.968 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profile": "myprofile", 2026-02-17T00:56:57.968 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_params": { 2026-02-17T00:56:57.968 INFO:tasks.workunit.client.0.trial092.stdout: "type": "none" 2026-02-17T00:56:57.968 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.968 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_period": 0, 2026-02-17T00:56:57.968 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_count": 0, 2026-02-17T00:56:57.969 INFO:tasks.workunit.client.0.trial092.stdout: "use_gmt_hitset": true, 2026-02-17T00:56:57.969 INFO:tasks.workunit.client.0.trial092.stdout: "min_read_recency_for_promote": 0, 2026-02-17T00:56:57.969 INFO:tasks.workunit.client.0.trial092.stdout: "min_write_recency_for_promote": 0, 2026-02-17T00:56:57.969 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T00:56:57.969 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_search_last_n": 0, 2026-02-17T00:56:57.969 INFO:tasks.workunit.client.0.trial092.stdout: "grade_table": [], 2026-02-17T00:56:57.969 INFO:tasks.workunit.client.0.trial092.stdout: "stripe_width": 8192, 2026-02-17T00:56:57.969 INFO:tasks.workunit.client.0.trial092.stdout: "expected_num_objects": 0, 2026-02-17T00:56:57.969 INFO:tasks.workunit.client.0.trial092.stdout: "fast_read": false, 2026-02-17T00:56:57.969 INFO:tasks.workunit.client.0.trial092.stdout: "nonprimary_shards": "{}", 2026-02-17T00:56:57.970 INFO:tasks.workunit.client.0.trial092.stdout: "options": {}, 2026-02-17T00:56:57.970 INFO:tasks.workunit.client.0.trial092.stdout: "application_metadata": {} 2026-02-17T00:56:57.970 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.970 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:57.970 INFO:tasks.workunit.client.0.trial092.stdout: "osds": [ 2026-02-17T00:56:57.970 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.970 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:56:57.970 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "b75a4676-94b7-4664-91a3-24464591fad4", 2026-02-17T00:56:57.970 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:56:57.970 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:56:57.970 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:56:57.971 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:56:57.971 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 5, 2026-02-17T00:56:57.971 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 28, 2026-02-17T00:56:57.971 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 36, 2026-02-17T00:56:57.971 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 43, 2026-02-17T00:56:57.971 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 30, 2026-02-17T00:56:57.971 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:56:57.971 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:56:57.971 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.971 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.972 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.972 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6800", 2026-02-17T00:56:57.972 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2999222288 2026-02-17T00:56:57.972 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.972 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.972 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.972 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6801", 2026-02-17T00:56:57.972 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2999222288 2026-02-17T00:56:57.972 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.972 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.973 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.973 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:56:57.973 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.973 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.973 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.973 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6802", 2026-02-17T00:56:57.973 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2999222288 2026-02-17T00:56:57.973 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.973 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.973 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.973 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6803", 2026-02-17T00:56:57.974 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2999222288 2026-02-17T00:56:57.974 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.974 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.974 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.974 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:56:57.974 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.974 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.974 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.974 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6806", 2026-02-17T00:56:57.974 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2999222288 2026-02-17T00:56:57.974 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.975 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.975 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.975 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6807", 2026-02-17T00:56:57.975 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2999222288 2026-02-17T00:56:57.975 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.975 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.975 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.975 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:56:57.975 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.975 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.975 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.976 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6804", 2026-02-17T00:56:57.976 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2999222288 2026-02-17T00:56:57.976 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.976 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.976 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.976 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6805", 2026-02-17T00:56:57.976 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 2999222288 2026-02-17T00:56:57.976 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.976 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.976 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6801/2999222288", 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6803/2999222288", 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2999222288", 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2999222288", 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "0b8cd378-df63-4db1-b324-92cb2f73843e", 2026-02-17T00:56:57.977 INFO:tasks.workunit.client.0.trial092.stdout: "up": 0, 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 0, 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 0, 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 9, 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 24, 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 31, 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.978 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.979 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.980 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.981 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.982 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:56:57.982 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.982 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.982 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.982 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:56:57.982 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:56:57.982 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.982 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.982 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.982 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:56:57.982 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/799948587", 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/799948587", 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/799948587", 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/799948587", 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: "exists" 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.983 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "138b856d-62e1-4fec-be2e-b1915a8a6d08", 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 14, 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 28, 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 39, 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 0, 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 32, 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:56:57.984 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1431357102 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1431357102 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:56:57.985 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1431357102 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1431357102 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.986 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.987 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:56:57.987 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.987 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.987 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.987 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:56:57.987 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1431357102 2026-02-17T00:56:57.987 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.987 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.987 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.987 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:56:57.987 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1431357102 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1431357102 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:56:57.988 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1431357102 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/1431357102", 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/1431357102", 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1431357102", 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1431357102", 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: "osd_xinfo": [ 2026-02-17T00:56:57.989 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:56:07.520240+0000", 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:55:31.570571+0000", 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:56:57.990 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:56:07.811630+0000", 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:55:33.596999+0000", 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:56:08.101313+0000", 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:56:57.991 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:55:36.199856+0000", 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap": [], 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_items": [], 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_primaries": [], 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: "pg_temp": [], 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: "primary_temp": [], 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: "blocklist": {}, 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: "range_blocklist": {}, 2026-02-17T00:56:57.992 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profiles": { 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "default": { 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "k": "2", 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "m": "2", 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "plugin": "isa", 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "technique": "reed_sol_van" 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "myprofile": { 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "crush-device-class": "", 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "crush-failure-domain": "osd", 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "crush-num-failure-domains": "0", 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "crush-osds-per-failure-domain": "0", 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "crush-root": "default", 2026-02-17T00:56:57.993 INFO:tasks.workunit.client.0.trial092.stdout: "k": "2", 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "m": "1", 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "plugin": "isa", 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "technique": "reed_sol_van" 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps_queue": [], 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "new_removed_snaps": [], 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "new_purged_snaps": [], 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "crush_node_flags": {}, 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "device_class_flags": {}, 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": { 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_enabled": false, 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_bucket_count": 0, 2026-02-17T00:56:57.994 INFO:tasks.workunit.client.0.trial092.stdout: "degraded_stretch_mode": 0, 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: "recovering_stretch_mode": 0, 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_bucket": 0 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: "osd_metadata": [ 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6802/2999222288,v1:127.0.0.1:6803/2999222288]", 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:56:57.995 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:56:57.996 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:55:29.838840Z", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:56:57.997 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6800/2999222288,v1:127.0.0.1:6801/2999222288]", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2999222288,v1:127.0.0.1:6807/2999222288]", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2999222288,v1:127.0.0.1:6805/2999222288]", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T00:56:57.998 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/799948587,v1:127.0.0.1:6813/799948587]", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:56:57.999 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:55:31.743606Z", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:56:58.000 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/799948587,v1:127.0.0.1:6811/799948587]", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/799948587,v1:127.0.0.1:6817/799948587]", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/799948587,v1:127.0.0.1:6815/799948587]", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T00:56:58.001 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/1431357102,v1:127.0.0.1:6813/1431357102]", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:56:58.002 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:55:34.370636Z", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/1431357102,v1:127.0.0.1:6811/1431357102]", 2026-02-17T00:56:58.003 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1431357102,v1:127.0.0.1:6817/1431357102]", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1431357102,v1:127.0.0.1:6815/1431357102]", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_clean_epochs": { 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "min_last_epoch_clean": 0, 2026-02-17T00:56:58.004 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": { 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "per_pool": [] 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "osd_epochs": [ 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 36 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 39 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_first_committed": 1, 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_last_committed": 44, 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "crushmap": { 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "devices": [ 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.0", 2026-02-17T00:56:58.005 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.1", 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.2", 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: "types": [ 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 0, 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd" 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:56:58.006 INFO:tasks.workunit.client.0.trial092.stdout: "name": "host" 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 2, 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: "name": "chassis" 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 3, 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: "name": "rack" 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 4, 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: "name": "row" 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 5, 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pdu" 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 6, 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pod" 2026-02-17T00:56:58.007 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 7, 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: "name": "room" 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 8, 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: "name": "datacenter" 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 9, 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: "name": "zone" 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 10, 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: "name": "region" 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: "name": "root" 2026-02-17T00:56:58.008 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "buckets": [ 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "id": -1, 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default", 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "id": -2, 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default~ssd", 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:56:58.009 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092", 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:56:58.010 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092~ssd", 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:56:58.011 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "rules": [ 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "rule_id": 0, 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "rule_name": "replicated_rule", 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "steps": [ 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "op": "take", 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "item": -1, 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "item_name": "default" 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "op": "choose_firstn", 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "num": 0, 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: "type": "osd" 2026-02-17T00:56:58.012 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "op": "emit" 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "rule_id": 1, 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "rule_name": "test", 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "type": 3, 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "steps": [ 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "op": "set_chooseleaf_tries", 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "num": 5 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "op": "set_choose_tries", 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "num": 100 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "op": "take", 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "item": -1, 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "item_name": "default" 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "op": "choose_indep", 2026-02-17T00:56:58.013 INFO:tasks.workunit.client.0.trial092.stdout: "num": 0, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "type": "osd" 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "op": "emit" 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "tunables": { 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_tries": 0, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_fallback_tries": 0, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "choose_total_tries": 50, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_descend_once": 1, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_vary_r": 1, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_stable": 1, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "msr_descents": 100, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "msr_collision_tries": 100, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "straw_calc_version": 1, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "allowed_bucket_algs": 54, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "profile": "jewel", 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_tunables": 1, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "legacy_tunables": 0, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "minimum_required_version": "jewel", 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables": 1, 2026-02-17T00:56:58.014 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables2": 1, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "has_v2_rules": 1, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables3": 1, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "has_v3_rules": 0, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "has_v4_buckets": 1, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables5": 1, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "has_v5_rules": 0, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "has_msr_rules": 0 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "choose_args": {} 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "fsmap": { 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "btime": "2026-02-17T00:55:29:151708+0000", 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "default_fscid": -1, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "compat": { 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "compat": {}, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "ro_compat": {}, 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "incompat": { 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "feature_1": "base v0.20", 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "feature_2": "client writeable ranges", 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "feature_4": "dir inode in separate object", 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "feature_8": "no anchor table", 2026-02-17T00:56:58.015 INFO:tasks.workunit.client.0.trial092.stdout: "feature_9": "file layout v2", 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "feature_10": "snaprealm v2", 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "feature_11": "minor log segments", 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "feature_flags": { 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "enable_multiple": true, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "ever_enabled_multiple": true 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "standbys": [], 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "filesystems": [] 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_first_committed": 1, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_last_committed": 1, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "auth": { 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 5, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "num_secrets": 3 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 1, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_active": 1, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_unknown": 0, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "num_osd": 3, 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "pool_sum": { 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:56:58.016 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 52200, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 101, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 1, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 303, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 101, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 101, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 101, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 101, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:56:58.017 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.018 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 18, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 18, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "up": 3, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 3, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 0 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum": { 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 3, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83948, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2172, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 29, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81698, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488852, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036584448, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2224128, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 1554904, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 30328, 2026-02-17T00:56:58.019 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83659144 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum_by_class": { 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "ssd": { 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 3, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 83948, 2026-02-17T00:56:58.020 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2172, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 29, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 81698, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314488852, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322036584448, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2224128, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 1554904, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 30328, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 83659144 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:56:58.021 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "pool_stats": [ 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": 1, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 1, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 52200, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 101, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 1, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 303, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 101, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 101, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 101, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 101, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:56:58.022 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 1241088, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 1241088, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:56:58.023 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 18, 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 18, 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "up": 3, 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 3, 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 3 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "osd_stats": [ 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 154618822668 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 38654705680 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 167503724556 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_state": [ 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "state": "active+undersized+degraded", 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "num": 1 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:58.024 INFO:tasks.workunit.client.0.trial092.stdout: "pool_pg_unavailable_map": [ 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": "1", 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "pgs": [] 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_osd": [ 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2147483647, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 1, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 0, 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:58.025 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": [ 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": {} 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "servicemap": { 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 3, 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:56:35.372190+0000", 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "services": { 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "osd": { 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "daemons": { 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "summary": "", 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "0": { 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "start_epoch": 0, 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "start_stamp": "0.000000", 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "gid": 0, 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "metadata": {}, 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "task_status": {} 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "2": { 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "start_epoch": 0, 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "start_stamp": "0.000000", 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "gid": 0, 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "metadata": {}, 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "task_status": {} 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:56:58.026 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_first_committed": 1, 2026-02-17T00:56:58.027 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_last_committed": 45, 2026-02-17T00:56:58.027 INFO:tasks.workunit.client.0.trial092.stdout: "logm_first_committed": 1, 2026-02-17T00:56:58.027 INFO:tasks.workunit.client.0.trial092.stdout: "logm_last_committed": 239, 2026-02-17T00:56:58.027 INFO:tasks.workunit.client.0.trial092.stdout: "paxos": { 2026-02-17T00:56:58.027 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:56:58.027 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 338, 2026-02-17T00:56:58.027 INFO:tasks.workunit.client.0.trial092.stdout: "last_pn": 0, 2026-02-17T00:56:58.027 INFO:tasks.workunit.client.0.trial092.stdout: "accepted_pn": 0 2026-02-17T00:56:58.027 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:56:58.027 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:56:58.027 INFO:tasks.workunit.client.0.trial092.stderr:report 1573712929 2026-02-17T00:56:58.028 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T00:56:58.028 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:56:58.028 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2026-02-17T00:56:58.028 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:56:58.028 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:56:58.028 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:56:58.028 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:56:58.028 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:56:58.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:56:58.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2026-02-17T00:56:58.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T00:56:58.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T00:56:58.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-17T00:56:58.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T00:56:58.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2026-02-17T00:56:58.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2026-02-17T00:56:58.171 INFO:tasks.workunit.client.0.trial092.stderr:PG '1.0' not found 2026-02-17T00:56:58.208 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:56:58.209 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:56:58.210 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:56:58.210 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:56:58.210 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:56:58.210 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:56:58.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:56:58.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:56:58.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:56:58.210 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T00:56:58.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T00:56:58.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:56:58.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:56:58.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:56:58.230 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:58.228+0000 7f179a02d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:58.231 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:58.229+0000 7f179a02d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:58.232 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:58.230+0000 7f179a02d780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:58.363 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:58.361+0000 7f179a02d780 -1 Falling back to public interface 2026-02-17T00:56:58.441 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T00:56:58.441 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:56:58.442 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:56:58.442 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:56:58.442 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:56:58.442 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:56:58.442 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:56:58.442 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:56:58.443 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:56:58.443 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:56:58.672 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 36 up_thru 43 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6800/2999222288,v1:127.0.0.1:6801/2999222288] [v2:127.0.0.1:6802/2999222288,v1:127.0.0.1:6803/2999222288] exists,up b75a4676-94b7-4664-91a3-24464591fad4 2026-02-17T00:56:58.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:56:58.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:56:58.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:56:58.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:56:58.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2026-02-17T00:56:58.674 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:56:58.674 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:56:58.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:56:58.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:56:58.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:56:58.724 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:58.722+0000 7f179a02d780 -1 osd.0 44 log_to_monitors true 2026-02-17T00:56:58.780 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:56:58.780 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2026-02-17T00:56:58.781 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T00:56:58.781 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T00:56:58.781 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-17T00:56:58.781 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T00:56:58.781 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2026-02-17T00:56:58.781 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2026-02-17T00:56:58.883 INFO:tasks.workunit.client.0.trial092.stderr:PG '1.0' not found 2026-02-17T00:56:58.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-17T00:56:58.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-17T00:56:58.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:56:58.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:56:58.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T00:56:58.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:56:58.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T00:56:58.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:56:58.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:56:58.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:56:58.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:56:58.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T00:56:58.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T00:56:58.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:56:58.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:56:58.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:56:58.931 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:56:58.931 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:56:58.931 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:56:58.931 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:56:58.931 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:56:58.932 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:56:58.933 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T00:56:58.933 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T00:56:58.933 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:56:58.934 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:56:58.934 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T00:56:58.934 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T00:56:58.934 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:56:58.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:56:58.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:56:58.947 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:58.946+0000 7f18ce02e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:58.949 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:58.948+0000 7f18ce02e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:58.950 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:58.948+0000 7f18ce02e780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:56:59.145 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:59.144+0000 7f18ce02e780 -1 Falling back to public interface 2026-02-17T00:56:59.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T00:56:59.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:56:59.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:56:59.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:56:59.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:56:59.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:56:59.164 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:56:59.165 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:56:59.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:56:59.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:56:59.409 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 39 up_thru 0 down_at 32 last_clean_interval [14,28) [v2:127.0.0.1:6810/1431357102,v1:127.0.0.1:6811/1431357102] [v2:127.0.0.1:6812/1431357102,v1:127.0.0.1:6813/1431357102] exists,up 138b856d-62e1-4fec-be2e-b1915a8a6d08 2026-02-17T00:56:59.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:56:59.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:56:59.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:56:59.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2026-02-17T00:56:59.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T00:56:59.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-17T00:56:59.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-17T00:56:59.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-17T00:56:59.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T00:56:59.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2026-02-17T00:56:59.433 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:56:59.431+0000 7f18ce02e780 -1 osd.2 44 log_to_monitors true 2026-02-17T00:56:59.518 INFO:tasks.workunit.client.0.trial092.stderr:PG '1.0' not found 2026-02-17T00:56:59.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-17T00:56:59.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T00:56:59.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2026-02-17T00:56:59.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:56:59.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:56:59.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:56:59.561 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T00:56:59.562 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:56:59.562 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:56:59.562 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:56:59.562 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:56:59.562 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:56:59.615 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T00:56:59.615 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:56:59.616 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:56:59.616 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:56:59.616 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:56:59.616 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:56:59.843 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:56:59.843 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:56:59.843 INFO:tasks.workunit.client.0.trial092.stderr:2' 2026-02-17T00:56:59.843 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:56:59.843 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:56:59.844 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:56:59.914 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=201863462915 2026-02-17T00:56:59.914 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 201863462915 2026-02-17T00:56:59.914 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-201863462915' 2026-02-17T00:56:59.914 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:56:59.914 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:56:59.964 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-17T00:56:59.964 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: true 2026-02-17T00:56:59.964 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-17T00:56:59.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: continue 2026-02-17T00:56:59.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:56:59.965 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:57:00.033 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=219043332099 2026-02-17T00:57:00.033 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 219043332099 2026-02-17T00:57:00.033 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-201863462915 2-219043332099' 2026-02-17T00:57:00.034 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:57:00.034 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-201863462915 2026-02-17T00:57:00.034 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:57:00.034 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:57:00.035 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-201863462915 2026-02-17T00:57:00.035 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:57:00.036 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=201863462915 2026-02-17T00:57:00.036 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 201863462915' 2026-02-17T00:57:00.037 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 201863462915 2026-02-17T00:57:00.037 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:57:00.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 201863462915 2026-02-17T00:57:00.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T00:57:01.266 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T00:57:01.266 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:57:01.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 201863462915 -lt 201863462915 2026-02-17T00:57:01.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:57:01.503 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-219043332099 2026-02-17T00:57:01.503 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:57:01.504 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:57:01.504 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-219043332099 2026-02-17T00:57:01.504 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:57:01.506 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=219043332099 2026-02-17T00:57:01.506 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 219043332099' 2026-02-17T00:57:01.506 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 219043332099 2026-02-17T00:57:01.506 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:57:01.745 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 219043332099 -lt 219043332099 2026-02-17T00:57:01.746 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:57:01.747 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:57:01.747 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:57:02.070 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:57:02.070 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:57:02.070 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:57:02.070 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:57:02.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:57:02.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:57:02.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:57:02.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:57:02.296 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:57:02.296 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:57:02.297 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:57:02.297 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:57:02.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:57:02.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-17T00:57:02.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-17T00:57:02.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-17T00:57:02.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:57:02.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-17T00:57:02.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:57:02.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:57:02.714 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:57:02.715 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:57:02.715 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:57:02.715 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:57:02.715 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:57:02.715 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:57:02.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:57:02.941 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:57:02.941 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:57:02.942 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:57:03.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:57:03.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:57:03.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:57:03.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:57:03.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:57:03.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:57:03.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:57:03.264 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:57:03.264 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:57:03.598 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:57:03.598 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:57:03.598 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-17T00:57:03.599 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:57:03.599 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-17T00:57:03.799 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:57:03.799 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:57:03.800 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:57:03.801 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:57:03.801 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:57:03.801 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:57:03.801 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:57:03.801 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:57:04.031 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:57:04.031 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:57:04.032 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:57:04.032 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:57:04.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:57:04.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:57:04.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:57:04.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:57:04.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:57:04.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:57:04.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:57:04.349 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:57:04.349 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:57:04.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:57:04.702 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:57:04.702 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-17T00:57:04.702 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:57:04.702 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-17T00:57:05.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:57:05.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:57:05.103 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:57:05.103 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:57:05.103 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:57:05.104 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:57:05.104 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:57:05.104 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:57:05.330 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:57:05.331 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:57:05.331 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:57:05.331 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:57:05.654 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:57:05.654 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:57:05.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:57:05.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:57:05.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:57:05.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:57:05.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:57:05.655 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:57:05.655 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:57:05.973 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:57:05.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:57:05.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-17T00:57:05.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:57:05.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-17T00:57:06.774 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:57:06.775 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:57:06.776 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:57:06.776 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:57:06.776 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:57:06.776 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:57:06.776 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:57:06.776 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:57:07.002 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:57:07.002 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:57:07.003 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:57:07.003 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:57:07.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:57:07.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:57:07.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:57:07.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:57:07.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:57:07.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:57:07.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:57:07.323 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:57:07.323 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:57:07.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:57:07.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:57:07.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-17T00:57:07.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:57:07.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-17T00:57:09.242 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:57:09.242 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:57:09.243 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:57:09.243 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:57:09.243 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:57:09.243 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:57:09.243 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:57:09.243 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:57:09.474 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:57:09.475 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:57:09.475 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:57:09.475 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:57:09.794 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:57:09.794 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:57:09.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:57:09.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:57:09.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:57:09.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:57:09.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:57:09.795 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:57:09.795 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:57:10.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:57:10.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:57:10.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-17T00:57:10.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:57:10.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-17T00:57:13.311 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:57:13.312 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:57:13.312 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:57:13.312 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:57:13.312 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:57:13.312 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:57:13.312 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:57:13.313 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:57:13.550 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:57:13.550 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:57:13.551 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:57:13.551 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:57:13.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:57:13.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:57:13.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:57:13.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:57:13.878 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:57:13.879 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:57:13.879 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:57:13.879 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:57:13.879 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:57:14.198 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:57:14.198 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:57:14.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-17T00:57:14.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:57:14.199 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-17T00:57:20.599 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:57:20.599 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:57:20.600 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:57:20.600 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:57:20.600 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:57:20.601 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:57:20.601 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:57:20.601 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:57:20.830 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:57:20.831 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:57:20.831 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:57:20.831 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:57:21.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:57:21.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:57:21.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:57:21.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:57:21.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:57:21.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:57:21.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:57:21.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:57:21.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:57:21.488 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:57:21.489 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:57:21.489 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-17T00:57:21.489 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-17T00:57:21.489 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-17T00:57:28.788 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-17T00:57:28.788 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:57:28.789 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:57:28.789 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:57:28.789 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:57:28.789 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:57:28.789 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:57:28.789 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:57:29.017 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-17T00:57:29.018 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:57:29.018 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:57:29.018 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:57:29.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-17T00:57:29.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-17T00:57:29.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-17T00:57:29.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-17T00:57:29.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T00:57:29.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T00:57:29.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T00:57:29.348 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-17T00:57:29.348 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T00:57:29.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-17T00:57:29.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-17T00:57:29.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-17T00:57:29.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-17T00:57:30.001 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:57:30.002 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_fingerprint": "8334ef58-6060-4be8-94c2-67d68a8d3a27", 2026-02-17T00:57:30.002 INFO:tasks.workunit.client.0.trial092.stdout: "version": "20.3.0-5225-g03ef619e", 2026-02-17T00:57:30.002 INFO:tasks.workunit.client.0.trial092.stdout: "commit": "03ef619e79a56cd363b087a5c6f19a1a09b49040", 2026-02-17T00:57:30.002 INFO:tasks.workunit.client.0.trial092.stdout: "timestamp": "2026-02-17T00:57:30.000938+0000", 2026-02-17T00:57:30.002 INFO:tasks.workunit.client.0.trial092.stdout: "tag": "", 2026-02-17T00:57:30.002 INFO:tasks.workunit.client.0.trial092.stdout: "health": { 2026-02-17T00:57:30.002 INFO:tasks.workunit.client.0.trial092.stdout: "status": "HEALTH_WARN", 2026-02-17T00:57:30.002 INFO:tasks.workunit.client.0.trial092.stdout: "checks": { 2026-02-17T00:57:30.002 INFO:tasks.workunit.client.0.trial092.stdout: "OSDMAP_FLAGS": { 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: "count": 17 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [], 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: "OSD_DOWN": { 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:57:30.003 INFO:tasks.workunit.client.0.trial092.stdout: "message": "1 osds down", 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: "count": 1 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: "message": "osd.1 (root=default,host=trial092) is down" 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: "PG_DEGRADED": { 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: "severity": "HEALTH_WARN", 2026-02-17T00:57:30.004 INFO:tasks.workunit.client.0.trial092.stdout: "summary": { 2026-02-17T00:57:30.005 INFO:tasks.workunit.client.0.trial092.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-17T00:57:30.005 INFO:tasks.workunit.client.0.trial092.stdout: "count": 1 2026-02-17T00:57:30.005 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.005 INFO:tasks.workunit.client.0.trial092.stdout: "detail": [ 2026-02-17T00:57:30.005 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.005 INFO:tasks.workunit.client.0.trial092.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-17T00:57:30.005 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.005 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.005 INFO:tasks.workunit.client.0.trial092.stdout: "muted": false 2026-02-17T00:57:30.005 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.005 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "mutes": [] 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_first_committed": 1, 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "monmap_last_committed": 1, 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "monmap": { 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:55:29.116872Z", 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:55:29.116872Z", 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release": 20, 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "min_mon_release_name": "tentacle", 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "election_strategy": 1, 2026-02-17T00:57:30.006 INFO:tasks.workunit.client.0.trial092.stdout: "disallowed_leaders": "", 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": false, 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "tiebreaker_mon": "", 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "removed_ranks": "", 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "features": { 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "persistent": [ 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "kraken", 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "luminous", 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "mimic", 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap-prune", 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "nautilus", 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "octopus", 2026-02-17T00:57:30.007 INFO:tasks.workunit.client.0.trial092.stdout: "pacific", 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: "elector-pinging", 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: "quincy", 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: "reef", 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: "squid", 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: "tentacle", 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: "nvmeof_beacon_diff" 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: "optional": [] 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: "mons": [ 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: "rank": 0, 2026-02-17T00:57:30.008 INFO:tasks.workunit.client.0.trial092.stdout: "name": "a", 2026-02-17T00:57:30.009 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:57:30.009 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.009 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.009 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.009 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115", 2026-02-17T00:57:30.009 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 0 2026-02-17T00:57:30.009 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.009 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.009 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.009 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T00:57:30.009 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: "priority": 0, 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 0, 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: "time_added": "2026-02-17T00:55:29:116868+0000", 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: "crush_location": [] 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: "quorum": [ 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: 0 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap": { 2026-02-17T00:57:30.010 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 52, 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "fsid": "a879066e-e834-4c6f-b9e2-98023025c932", 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "created": "2026-02-17T00:55:29.151863+0000", 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:56:59.830932+0000", 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "last_up_change": "2026-02-17T00:56:59.728489+0000", 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "last_in_change": "2026-02-17T00:56:12.878342+0000", 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "flags_num": 5800384, 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "flags_set": [ 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "nodown", 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "noin", 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "noout", 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "pglog_hardlimit", 2026-02-17T00:57:30.011 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snapdirs", 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "recovery_deletes", 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "sortbitwise" 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "crush_version": 12, 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_snapshot": "", 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "pool_max": 1, 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "max_osd": 3, 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "require_min_compat_client": "luminous", 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "min_compat_client": "jewel", 2026-02-17T00:57:30.012 INFO:tasks.workunit.client.0.trial092.stdout: "require_osd_release": "tentacle", 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: "allow_crimson": false, 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: "pools": [ 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: "pool_name": "test", 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: "create_time": "2026-02-17T00:55:37.852956+0000", 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: "flags": 16389, 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: "type": 3, 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: "size": 3, 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: "min_size": 2, 2026-02-17T00:57:30.013 INFO:tasks.workunit.client.0.trial092.stdout: "crush_rule": 1, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_count": 0, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_target": 0, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "is_stretch_pool": false, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "object_hash": 2, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "pg_autoscale_mode": "off", 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num": 1, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num": 1, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "pg_placement_num_target": 1, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_target": 1, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "pg_num_pending": 1, 2026-02-17T00:57:30.014 INFO:tasks.workunit.client.0.trial092.stdout: "last_pg_merge_meta": { 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "source_pgid": "0.0", 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "ready_epoch": 0, 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_started": 0, 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": 0, 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "source_version": "0'0", 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "target_version": "0'0" 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "last_change": "29", 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend": "0", 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "auid": 0, 2026-02-17T00:57:30.015 INFO:tasks.workunit.client.0.trial092.stdout: "snap_mode": "pool", 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: "snap_seq": 1, 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: "snap_epoch": 29, 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: "pool_snaps": [ 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: "snapid": 1, 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: "stamp": "2026-02-17T00:55:56.839934+0000", 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: "name": "snap1" 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps": "[]", 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_bytes": 0, 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: "quota_max_objects": 0, 2026-02-17T00:57:30.016 INFO:tasks.workunit.client.0.trial092.stdout: "tiers": [], 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "tier_of": -1, 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "read_tier": -1, 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "write_tier": -1, 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "cache_mode": "none", 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_bytes": 0, 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "target_max_objects": 0, 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_flush_age": 0, 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "cache_min_evict_age": 0, 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profile": "myprofile", 2026-02-17T00:57:30.017 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_params": { 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "type": "none" 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_period": 0, 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_count": 0, 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "use_gmt_hitset": true, 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "min_read_recency_for_promote": 0, 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "min_write_recency_for_promote": 0, 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "hit_set_search_last_n": 0, 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "grade_table": [], 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "stripe_width": 8192, 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "expected_num_objects": 0, 2026-02-17T00:57:30.018 INFO:tasks.workunit.client.0.trial092.stdout: "fast_read": false, 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: "nonprimary_shards": "{}", 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: "options": {}, 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: "application_metadata": {} 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: "osds": [ 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "b75a4676-94b7-4664-91a3-24464591fad4", 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:57:30.019 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 36, 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 44, 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 47, 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 51, 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 46, 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6800", 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3711045700 2026-02-17T00:57:30.020 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6801", 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3711045700 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.021 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6802", 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3711045700 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6803", 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3711045700 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.022 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6806", 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3711045700 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6807", 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3711045700 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:57:30.023 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6804", 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3711045700 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6805", 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 3711045700 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.024 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6801/3711045700", 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6803/3711045700", 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3711045700", 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3711045700", 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "0b8cd378-df63-4db1-b324-92cb2f73843e", 2026-02-17T00:57:30.025 INFO:tasks.workunit.client.0.trial092.stdout: "up": 0, 2026-02-17T00:57:30.026 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:57:30.026 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:57:30.026 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:57:30.026 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 0, 2026-02-17T00:57:30.026 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 0, 2026-02-17T00:57:30.026 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 9, 2026-02-17T00:57:30.026 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 24, 2026-02-17T00:57:30.026 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 31, 2026-02-17T00:57:30.026 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:57:30.026 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:57:30.026 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.027 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.027 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.027 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:57:30.027 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:57:30.027 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.027 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.027 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.027 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:57:30.027 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:57:30.027 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.027 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.028 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.028 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:57:30.028 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.028 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.028 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.028 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:57:30.028 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:57:30.028 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.028 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.028 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.029 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.030 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.030 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:57:30.030 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:57:30.030 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.030 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.030 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.030 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:57:30.030 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.030 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.030 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 799948587 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/799948587", 2026-02-17T00:57:30.031 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/799948587", 2026-02-17T00:57:30.032 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/799948587", 2026-02-17T00:57:30.032 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/799948587", 2026-02-17T00:57:30.032 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:57:30.032 INFO:tasks.workunit.client.0.trial092.stdout: "exists" 2026-02-17T00:57:30.032 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.032 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.032 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.032 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:57:30.032 INFO:tasks.workunit.client.0.trial092.stdout: "uuid": "138b856d-62e1-4fec-be2e-b1915a8a6d08", 2026-02-17T00:57:30.032 INFO:tasks.workunit.client.0.trial092.stdout: "up": 1, 2026-02-17T00:57:30.032 INFO:tasks.workunit.client.0.trial092.stdout: "in": 1, 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 1, 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "primary_affinity": 1, 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_begin": 39, 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "last_clean_end": 44, 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 51, 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "up_thru": 0, 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "down_at": 50, 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "lost_at": 0, 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "public_addrs": { 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6810", 2026-02-17T00:57:30.033 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1208712422 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6811", 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1208712422 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addrs": { 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6812", 2026-02-17T00:57:30.034 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1208712422 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6813", 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1208712422 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addrs": { 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6816", 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1208712422 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.035 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6817", 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1208712422 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addrs": { 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: "addrvec": [ 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v2", 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6814", 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1208712422 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: "type": "v1", 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "127.0.0.1:6815", 2026-02-17T00:57:30.036 INFO:tasks.workunit.client.0.trial092.stdout: "nonce": 1208712422 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: "public_addr": "127.0.0.1:6811/1208712422", 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: "cluster_addr": "127.0.0.1:6813/1208712422", 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1208712422", 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1208712422", 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: "state": [ 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: "exists", 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: "up" 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: "osd_xinfo": [ 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.037 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:56:58.923134+0000", 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:55:31.570571+0000", 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:56:07.811630+0000", 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:55:33.596999+0000", 2026-02-17T00:57:30.038 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "down_stamp": "2026-02-17T00:56:59.626463+0000", 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_probability": 0, 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "laggy_interval": 0, 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "features": 4544132024016699391, 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "old_weight": 0, 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "last_purged_snaps_scrub": "2026-02-17T00:55:36.199856+0000", 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "dead_epoch": 0 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap": [], 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_items": [], 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "pg_upmap_primaries": [], 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "pg_temp": [], 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "primary_temp": [], 2026-02-17T00:57:30.039 INFO:tasks.workunit.client.0.trial092.stdout: "blocklist": {}, 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "range_blocklist": {}, 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "erasure_code_profiles": { 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "default": { 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "k": "2", 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "m": "2", 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "plugin": "isa", 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "technique": "reed_sol_van" 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "myprofile": { 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "crush-device-class": "", 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "crush-failure-domain": "osd", 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "crush-num-failure-domains": "0", 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "crush-osds-per-failure-domain": "0", 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "crush-root": "default", 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "k": "2", 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "m": "1", 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "plugin": "isa", 2026-02-17T00:57:30.040 INFO:tasks.workunit.client.0.trial092.stdout: "technique": "reed_sol_van" 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "removed_snaps_queue": [], 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "new_removed_snaps": [], 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "new_purged_snaps": [], 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "crush_node_flags": {}, 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "device_class_flags": {}, 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode": { 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_enabled": false, 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_bucket_count": 0, 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "degraded_stretch_mode": 0, 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "recovering_stretch_mode": 0, 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "stretch_mode_bucket": 0 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "osd_metadata": [ 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.041 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6802/3711045700,v1:127.0.0.1:6803/3711045700]", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:57:30.042 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:55:29.838840Z", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6800/3711045700,v1:127.0.0.1:6801/3711045700]", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3711045700,v1:127.0.0.1:6807/3711045700]", 2026-02-17T00:57:30.043 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3711045700,v1:127.0.0.1:6805/3711045700]", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/799948587,v1:127.0.0.1:6813/799948587]", 2026-02-17T00:57:30.044 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:57:30.045 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:55:31.743606Z", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/799948587,v1:127.0.0.1:6811/799948587]", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/799948587,v1:127.0.0.1:6817/799948587]", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/799948587,v1:127.0.0.1:6815/799948587]", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:57:30.046 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "arch": "x86_64", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "back_addr": "[v2:127.0.0.1:6812/1208712422,v1:127.0.0.1:6813/1208712422]", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "back_iface": "", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs": "1", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_db": "0", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T00:57:30.047 INFO:tasks.workunit.client.0.trial092.stdout: "bluefs_single_shared_device": "1", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_allocator": "hybrid", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_devices": "nvme1n1", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "bluestore_write_mode": "classic", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_release": "tentacle", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_short": "20.3.0-5225-g03ef619e", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "ceph_version_when_created": "ceph version 20.3.0-5225-g03ef619e (03ef619e79a56cd363b087a5c6f19a1a09b49040) tentacle (dev - RelWithDebInfo)", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T00:57:30.048 INFO:tasks.workunit.client.0.trial092.stdout: "created_at": "2026-02-17T00:55:34.370636Z", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "default_device_class": "ssd", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "device_ids": "nvme1n1=Micron_7450_MTFDKBA960TFR_25174FCD4697", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "device_paths": "nvme1n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "devices": "nvme1n1", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "distro": "centos", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "distro_description": "CentOS Stream 9", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "distro_version": "9", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "front_addr": "[v2:127.0.0.1:6810/1208712422,v1:127.0.0.1:6811/1208712422]", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "front_iface": "", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1208712422,v1:127.0.0.1:6817/1208712422]", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1208712422,v1:127.0.0.1:6815/1208712422]", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "hostname": "trial092", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "journal_rotational": "0", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Wed Feb 11 20:19:22 UTC 2026", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "kernel_version": "5.14.0-681.el9.x86_64", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "mem_swap_kb": "8388604", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "mem_total_kb": "130438940", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_node": "0", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "objectstore_numa_nodes": "0", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "os": "Linux", 2026-02-17T00:57:30.049 INFO:tasks.workunit.client.0.trial092.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "osd_objectstore": "bluestore", 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "osdspec_affinity": "", 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "rotational": "0" 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_clean_epochs": { 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "min_last_epoch_clean": 25, 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "last_epoch_clean": { 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "per_pool": [ 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": 1, 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "floor": 25 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "osd_epochs": [ 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 51 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:57:30.050 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 51 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_first_committed": 1, 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "osdmap_last_committed": 52, 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "crushmap": { 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "devices": [ 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.0", 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.1", 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd.2", 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: "class": "ssd" 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.051 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "types": [ 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 0, 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "name": "osd" 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "name": "host" 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 2, 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "name": "chassis" 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 3, 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "name": "rack" 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 4, 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "name": "row" 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 5, 2026-02-17T00:57:30.052 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pdu" 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 6, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "name": "pod" 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 7, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "name": "room" 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 8, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "name": "datacenter" 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 9, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "name": "zone" 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 10, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "name": "region" 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: "name": "root" 2026-02-17T00:57:30.053 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "buckets": [ 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "id": -1, 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default", 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "id": -2, 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "name": "default~ssd", 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 11, 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "root", 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:57:30.054 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "id": -3, 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092", 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:57:30.055 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "id": -4, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "name": "trial092~ssd", 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "type_id": 1, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "type_name": "host", 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 19206, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "alg": "straw2", 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "hash": "rjenkins1", 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "items": [ 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "id": 0, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 0 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "id": 1, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 1 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.056 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "id": 2, 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "weight": 6402, 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "pos": 2 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "rules": [ 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "rule_id": 0, 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "rule_name": "replicated_rule", 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "type": 1, 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "steps": [ 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "op": "take", 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "item": -1, 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "item_name": "default" 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "op": "choose_firstn", 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "num": 0, 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "type": "osd" 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: "op": "emit" 2026-02-17T00:57:30.057 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "rule_id": 1, 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "rule_name": "test", 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "type": 3, 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "steps": [ 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "op": "set_chooseleaf_tries", 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "num": 5 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "op": "set_choose_tries", 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "num": 100 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "op": "take", 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "item": -1, 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "item_name": "default" 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "op": "choose_indep", 2026-02-17T00:57:30.058 INFO:tasks.workunit.client.0.trial092.stdout: "num": 0, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "type": "osd" 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "op": "emit" 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: ] 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "tunables": { 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_tries": 0, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "choose_local_fallback_tries": 0, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "choose_total_tries": 50, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_descend_once": 1, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_vary_r": 1, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "chooseleaf_stable": 1, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "msr_descents": 100, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "msr_collision_tries": 100, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "straw_calc_version": 1, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "allowed_bucket_algs": 54, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "profile": "jewel", 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "optimal_tunables": 1, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "legacy_tunables": 0, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "minimum_required_version": "jewel", 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables": 1, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables2": 1, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "has_v2_rules": 1, 2026-02-17T00:57:30.059 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables3": 1, 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "has_v3_rules": 0, 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "has_v4_buckets": 1, 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "require_feature_tunables5": 1, 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "has_v5_rules": 0, 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "has_msr_rules": 0 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "choose_args": {} 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "fsmap": { 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 1, 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "btime": "2026-02-17T00:55:29:151708+0000", 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "default_fscid": -1, 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "compat": { 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "compat": {}, 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "ro_compat": {}, 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "incompat": { 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "feature_1": "base v0.20", 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "feature_2": "client writeable ranges", 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "feature_4": "dir inode in separate object", 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "feature_8": "no anchor table", 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "feature_9": "file layout v2", 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "feature_10": "snaprealm v2", 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "feature_11": "minor log segments", 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.060 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "feature_flags": { 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "enable_multiple": true, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "ever_enabled_multiple": true 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "standbys": [], 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "filesystems": [] 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_first_committed": 1, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "mdsmap_last_committed": 1, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "auth": { 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 5, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_secrets": 3 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 1, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_active": 1, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_unknown": 0, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_osd": 3, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "pool_sum": { 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 52200, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 101, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 1, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 303, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 101, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:57:30.061 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 101, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 101, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 101, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:57:30.062 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 18, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 18, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "up": 3, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 3, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 0 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum": { 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 3, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:57:30.063 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 85100, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2300, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 29, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 82722, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314487700, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322035404800, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2355200, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 1608844, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 30301, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 84707747 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:57:30.064 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "osd_sum_by_class": { 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "ssd": { 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "up_from": 0, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 0, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "num_pgs": 3, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "num_osds": 3, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_osds": 3, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "kb": 314572800, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used": 85100, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_data": 2300, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_omap": 29, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "kb_used_meta": 82722, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "kb_avail": 314487700, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "statfs": { 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "total": 322122547200, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "available": 322035404800, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 2355200, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 1608844, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 30301, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 84707747 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "hb_peers": [], 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "snap_trim_queue_len": 0, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "num_snap_trimming": 0, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "num_shards_repaired": 0, 2026-02-17T00:57:30.065 INFO:tasks.workunit.client.0.trial092.stdout: "op_queue_age_hist": { 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "histogram": [], 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "upper_bound": 1 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "perf_stat": { 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ms": 0, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ms": 0, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "commit_latency_ns": 0, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "apply_latency_ns": 0 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "alerts": [], 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "network_ping_times": [] 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "pool_stats": [ 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": 1, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg": 1, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "stat_sum": { 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes": 52200, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects": 101, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_clones": 1, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_object_copies": 303, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_missing": 0, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_degraded": 101, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_misplaced": 0, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_unfound": 0, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_dirty": 101, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_whiteouts": 0, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_read": 0, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_read_kb": 0, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_write": 101, 2026-02-17T00:57:30.066 INFO:tasks.workunit.client.0.trial092.stdout: "num_write_kb": 101, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_scrub_errors": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_deep_scrub_errors": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_recovered": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_recovered": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_keys_recovered": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_omap": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_kb": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_kb": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_promote": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_high": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_flush_mode_low": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_some": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_evict_mode_full": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_pinned": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_legacy_snapsets": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_large_omap_objects": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_manifest": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_bytes": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_omap_keys": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "num_objects_repaired": 0 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "store_stats": { 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "total": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "available": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "internally_reserved": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "allocated": 1241088, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "data_stored": 1241088, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed": 0, 2026-02-17T00:57:30.067 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_allocated": 0, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "data_compressed_original": 0, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "omap_allocated": 0, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "internal_metadata": 0 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "log_size": 18, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "ondisk_log_size": 18, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "up": 3, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "acting": 3, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "num_store_stats": 3 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "osd_stats": [ 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 201863462921 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 38654705680 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "seq": 219043332104 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_state": [ 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "state": "active+undersized+degraded", 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "num": 1 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.068 INFO:tasks.workunit.client.0.trial092.stdout: "pool_pg_unavailable_map": [ 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "poolid": "1", 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "pgs": [] 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_pg_by_osd": [ 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2147483647, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 2, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 0, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 1, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 1, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "osd": 1, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_primary_pg": 0, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_acting_pg": 0, 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "num_up_not_acting_pg": 0 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": [ 2026-02-17T00:57:30.069 INFO:tasks.workunit.client.0.trial092.stdout: { 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "pool": 1, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "purged_snaps": {} 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: ], 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "servicemap": { 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "epoch": 3, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "modified": "2026-02-17T00:56:35.372190+0000", 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "services": { 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "osd": { 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "daemons": { 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "summary": "", 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "0": { 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "start_epoch": 0, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "start_stamp": "0.000000", 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "gid": 0, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "metadata": {}, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "task_status": {} 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "2": { 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "start_epoch": 0, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "start_stamp": "0.000000", 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "gid": 0, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "metadata": {}, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "task_status": {} 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: }, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_first_committed": 1, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "mgrstat_last_committed": 61, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "logm_first_committed": 1, 2026-02-17T00:57:30.070 INFO:tasks.workunit.client.0.trial092.stdout: "logm_last_committed": 316, 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stdout: "paxos": { 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stdout: "first_committed": 1, 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stdout: "last_committed": 439, 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stdout: "last_pn": 0, 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stdout: "accepted_pn": 0 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stdout: } 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stderr:report 2290476134 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stdout:delay recovery 2026-02-17T00:57:30.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:57:30.231 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:57:30.231 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T00:57:00.472775+0000 44'102 52:149 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:04:33.584658+0000 0 0 2026-02-17T00:57:30.232 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:57:30.232 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:57:30.232 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:57:30.239 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:57:30.240 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2026-02-17T00:57:30.240 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-17T00:57:30.240 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-17T00:57:30.240 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:57:30.240 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:57:30.241 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:57:30.241 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.0.asok 2026-02-17T00:57:30.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T00:57:30.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T00:57:30.287 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:57:30.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-17T00:57:30.292 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2026-02-17T00:57:30.292 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-17T00:57:30.292 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-17T00:57:30.293 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:57:30.293 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:57:30.293 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:57:30.293 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.2.asok 2026-02-17T00:57:30.293 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T00:57:30.293 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T00:57:30.338 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:57:30.343 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2026-02-17T00:57:30.343 INFO:tasks.workunit.client.0.trial092.stdout:revive divergent 1 2026-02-17T00:57:30.343 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:57:30.560 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:57:30.560 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T00:57:00.472775+0000 44'102 52:149 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:04:33.584658+0000 0 0 2026-02-17T00:57:30.560 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:57:30.560 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:57:30.561 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:57:30.567 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2026-02-17T00:57:30.890 INFO:tasks.workunit.client.0.trial092.stderr:noup is set 2026-02-17T00:57:30.905 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-17T00:57:30.905 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:57:30.905 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:57:30.905 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T00:57:30.905 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:57:30.906 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:57:30.906 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:57:30.906 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:57:30.906 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:57:30.906 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:57:30.906 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:57:30.906 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:57:30.906 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:57:30.906 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:57:30.906 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:57:30.907 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:57:30.907 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:57:30.907 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:57:30.907 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:57:30.907 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:57:30.907 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:57:30.907 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:57:30.907 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:57:30.907 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:57:30.907 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:57:30.908 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:57:30.908 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:57:30.908 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:57:30.908 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:57:30.908 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:57:30.908 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:57:30.908 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:57:30.908 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:57:30.908 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T00:57:30.909 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:57:30.910 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:57:30.910 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T00:57:30.910 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T00:57:30.910 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:57:30.910 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:57:30.910 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:57:30.923 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:57:30.922+0000 7ff9cbe0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:57:30.925 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:57:30.924+0000 7ff9cbe0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:57:30.926 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:57:30.924+0000 7ff9cbe0c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:57:31.056 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:57:31.054+0000 7ff9cbe0c780 -1 Falling back to public interface 2026-02-17T00:57:31.136 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-17T00:57:31.136 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2026-02-17T00:57:31.339 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:57:31.337+0000 7ff9cbe0c780 -1 osd.1 29 log_to_monitors true 2026-02-17T00:57:36.137 INFO:tasks.workunit.client.0.trial092.stdout:delay recovery divergent 2026-02-17T00:57:36.138 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2026-02-17T00:57:36.138 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:57:36.356 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:57:36.356 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T00:57:00.472775+0000 44'102 55:154 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:04:33.584658+0000 0 0 2026-02-17T00:57:36.356 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:57:36.356 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:57:36.356 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:57:36.364 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2026-02-17T00:57:36.365 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-17T00:57:36.365 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-17T00:57:36.365 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:57:36.365 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:57:36.365 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:57:36.365 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.44472/ceph-osd.1.asok 2026-02-17T00:57:36.366 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T00:57:36.366 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.44472/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T00:57:36.412 INFO:tasks.workunit.client.0.trial092.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T00:57:36.416 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2026-02-17T00:57:36.735 INFO:tasks.workunit.client.0.trial092.stderr:noup is unset 2026-02-17T00:57:36.747 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2026-02-17T00:57:36.747 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:57:36.747 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:57:36.747 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:57:36.747 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:57:36.747 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:57:36.748 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:57:36.748 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:57:36.748 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:57:36.748 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:57:36.979 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 47 up_thru 51 down_at 46 last_clean_interval [36,44) [v2:127.0.0.1:6800/3711045700,v1:127.0.0.1:6801/3711045700] [v2:127.0.0.1:6802/3711045700,v1:127.0.0.1:6803/3711045700] exists,up b75a4676-94b7-4664-91a3-24464591fad4 2026-02-17T00:57:36.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:57:36.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:57:36.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:57:36.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2026-02-17T00:57:36.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:57:36.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:57:36.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:57:36.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:57:36.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:57:36.981 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:57:36.981 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:57:36.982 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:57:36.982 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:57:37.211 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 57 up_thru 57 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/883381723,v1:127.0.0.1:6819/883381723] [v2:127.0.0.1:6820/883381723,v1:127.0.0.1:6821/883381723] exists,up 0b8cd378-df63-4db1-b324-92cb2f73843e 2026-02-17T00:57:37.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:57:37.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:57:37.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:57:37.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2026-02-17T00:57:37.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:57:37.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:57:37.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:57:37.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:57:37.213 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:57:37.213 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:57:37.213 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:57:37.213 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:57:37.213 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:57:37.447 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 51 up_thru 0 down_at 50 last_clean_interval [39,44) [v2:127.0.0.1:6810/1208712422,v1:127.0.0.1:6811/1208712422] [v2:127.0.0.1:6812/1208712422,v1:127.0.0.1:6813/1208712422] exists,up 138b856d-62e1-4fec-be2e-b1915a8a6d08 2026-02-17T00:57:37.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:57:37.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:57:37.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:57:37.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:57:37.667 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:57:37.667 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T00:57:00.472775+0000 44'102 55:154 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:04:33.584658+0000 0 0 2026-02-17T00:57:37.667 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:57:37.667 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:57:37.668 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:57:37.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2026-02-17T00:57:37.674 INFO:tasks.workunit.client.0.trial092.stdout:wait for peering 2026-02-17T00:57:37.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:57:37.895 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:57:37.895 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T00:57:00.472775+0000 44'102 55:154 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:04:33.584658+0000 0 0 2026-02-17T00:57:37.895 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:57:37.895 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:57:37.896 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:57:37.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /tmp/tmp.GRJdY5VaAe 2026-02-17T00:57:37.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:369: TEST_divergent_ec: rm -f /tmp/tmp.GRJdY5VaAe 2026-02-17T00:57:37.923 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: echo 'killing divergent 1' 2026-02-17T00:57:37.923 INFO:tasks.workunit.client.0.trial092.stdout:killing divergent 1 2026-02-17T00:57:37.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:57:38.139 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:57:38.140 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T00:57:00.472775+0000 44'102 55:154 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:04:33.584658+0000 0 0 2026-02-17T00:57:38.140 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:57:38.140 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:57:38.140 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:57:38.147 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:373: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T00:57:38.148 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:57:38.148 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:57:38.148 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:57:38.148 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:57:38.148 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:57:38.254 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:57:38.255 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: echo 'reviving divergent 1' 2026-02-17T00:57:38.255 INFO:tasks.workunit.client.0.trial092.stdout:reviving divergent 1 2026-02-17T00:57:38.255 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:57:38.485 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:57:38.485 INFO:tasks.workunit.client.0.trial092.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-17T00:57:00.472775+0000 44'102 55:154 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T03:04:33.584658+0000 0 0 2026-02-17T00:57:38.485 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:57:38.485 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:57:38.485 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:57:38.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:377: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-17T00:57:38.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-17T00:57:38.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:57:38.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T00:57:38.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:57:38.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T00:57:38.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:57:38.495 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:57:38.496 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:57:38.496 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:57:38.496 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:57:38.497 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' 2026-02-17T00:57:38.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:57:38.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T00:57:38.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T00:57:38.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:57:38.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:57:38.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:57:38.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:57:38.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:57:38.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:57:38.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T00:57:38.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T00:57:38.499 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:57:38.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=a879066e-e834-4c6f-b9e2-98023025c932 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.44472/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:57:38.500 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T00:57:38.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T00:57:38.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:57:38.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:57:38.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:57:38.514 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:57:38.513+0000 7feacbe11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:57:38.515 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:57:38.514+0000 7feacbe11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:57:38.516 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:57:38.515+0000 7feacbe11780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:57:38.650 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:57:38.648+0000 7feacbe11780 -1 Falling back to public interface 2026-02-17T00:57:38.727 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T00:57:38.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:57:38.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:57:38.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:57:38.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:57:38.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:57:38.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:57:38.728 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:57:38.729 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:57:38.729 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:57:38.926 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:57:38.925+0000 7feacbe11780 -1 osd.1 58 log_to_monitors true 2026-02-17T00:57:38.957 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 57 up_thru 57 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/883381723,v1:127.0.0.1:6819/883381723] [v2:127.0.0.1:6820/883381723,v1:127.0.0.1:6821/883381723] exists,up 0b8cd378-df63-4db1-b324-92cb2f73843e 2026-02-17T00:57:38.958 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:57:38.958 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:57:38.958 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:57:38.958 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:379: TEST_divergent_ec: sleep 20 2026-02-17T00:57:58.958 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: echo 'allowing recovery' 2026-02-17T00:57:58.958 INFO:tasks.workunit.client.0.trial092.stdout:allowing recovery 2026-02-17T00:57:58.959 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:382: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:57:59.185 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:57:59.186 INFO:tasks.workunit.client.0.trial092.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-17T00:57:39.321782+0000 58'103 62:158 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:05:15.208386+0000 0 0 2026-02-17T00:57:59.186 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:57:59.186 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:57:59.186 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:57:59.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-17T00:57:59.192 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T00:57:59.255 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:57:59.260 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-17T00:57:59.261 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T00:57:59.322 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:57:59.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-17T00:57:59.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T00:57:59.390 INFO:tasks.workunit.client.0.trial092.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T00:57:59.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: echo 'reading divergent objects' 2026-02-17T00:57:59.397 INFO:tasks.workunit.client.0.trial092.stdout:reading divergent objects 2026-02-17T00:57:59.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T00:57:59.618 INFO:tasks.workunit.client.0.trial092.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T00:57:59.618 INFO:tasks.workunit.client.0.trial092.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-17T00:57:39.321782+0000 58'103 62:158 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T00:55:37.948359+0000 0'0 2026-02-17T00:55:37.948359+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:05:15.208386+0000 0 0 2026-02-17T00:57:59.618 INFO:tasks.workunit.client.0.trial092.stdout: 2026-02-17T00:57:59.618 INFO:tasks.workunit.client.0.trial092.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T00:57:59.618 INFO:tasks.workunit.client.0.trial092.stderr:dumped pgs 2026-02-17T00:57:59.626 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: expr 2 + 2 2026-02-17T00:57:59.626 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: seq 1 4 2026-02-17T00:57:59.627 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:57:59.627 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T00:57:59.647 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:57:59.647 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T00:57:59.667 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:57:59.667 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T00:57:59.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T00:57:59.686 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T00:57:59.704 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:395: TEST_divergent_ec: rm -f td/divergent-priors/existing 2026-02-17T00:57:59.705 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-17T00:57:59.706 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.756+0000 7ff9ad714640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-17T00:55:51.919036+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.756+0000 7ff9ad714640 20 _merge_object_divergent_entries: keeping 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-17T00:55:51.919036+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.756+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.756+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 28'99 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.756+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.756+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-17T00:55:56.912310+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 20 _merge_object_divergent_entries: keeping 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-17T00:55:56.912310+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 28'99 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 29'104 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4561.0:1 2026-02-17T00:55:56.912310+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-17T00:57:59.710 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2026-02-17T00:57:59.711 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4552.0:1 2026-02-17T00:55:55.837802+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false,28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-17T00:55:56.841264+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:57:59.711 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 20 _merge_object_divergent_entries: keeping 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4552.0:1 2026-02-17T00:55:55.837802+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:57:59.711 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 20 _merge_object_divergent_entries: keeping 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-17T00:55:56.841264+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:57:59.711 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T00:57:59.711 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 28'100 first_divergent_update: 28'101 last_divergent_update: 28'102 2026-02-17T00:57:59.711 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-17T00:57:59.711 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-17T00:57:59.711 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 29'104 2026-02-17T00:57:59.711 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4558.0:1 2026-02-17T00:55:56.841264+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-17T00:57:59.711 INFO:tasks.workunit.client.0.trial092.stdout:td/divergent-priors/osd.1.log:2026-02-17T00:57:37.757+0000 7ff9ad714640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-17T00:57:59.711 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-17T00:57:59.712 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.0.log td/divergent-priors/osd.1.log td/divergent-priors/osd.2.log 2026-02-17T00:57:59.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:411: TEST_divergent_ec: echo success 2026-02-17T00:57:59.716 INFO:tasks.workunit.client.0.trial092.stdout:success 2026-02-17T00:57:59.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: delete_pool test 2026-02-17T00:57:59.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-17T00:57:59.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T00:57:59.992 INFO:tasks.workunit.client.0.trial092.stderr:pool 'test' does not exist 2026-02-17T00:58:00.000 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:414: TEST_divergent_ec: kill_daemons td/divergent-priors 2026-02-17T00:58:00.001 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:58:00.001 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:58:00.002 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:58:00.002 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:58:00.002 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:58:05.315 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:58:05.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T00:58:05.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T00:58:05.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:58:05.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T00:58:05.316 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:58:05.316 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:58:05.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:58:05.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:58:05.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:58:05.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:58:05.321 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:58:05.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:58:05.322 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:58:05.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:58:05.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:58:05.324 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:58:05.324 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:05.324 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:58:05.324 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:58:05.325 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:05.325 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:58:05.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:58:05.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T00:58:05.343 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:58:05.343 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:05.343 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:58:05.343 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44472 2026-02-17T00:58:05.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:58:05.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:58:05.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T00:58:05.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/divergent-priors 0 2026-02-17T00:58:05.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-17T00:58:05.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T00:58:05.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T00:58:05.346 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:58:05.346 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:58:05.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:58:05.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:58:05.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:58:05.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:58:05.347 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:58:05.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:58:05.347 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:58:05.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:58:05.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:58:05.349 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:58:05.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:05.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:58:05.350 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:58:05.350 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:05.350 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:58:05.351 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T00:58:05.351 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-17T00:58:05.353 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:58:05.353 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:05.353 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.44472 2026-02-17T00:58:05.353 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.44472 2026-02-17T00:58:05.354 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:58:05.354 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:58:05.354 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T00:58:05.355 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T00:58:05.355 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T00:58:05.382 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2026-02-17T00:58:05.382 DEBUG:teuthology.orchestra.run.trial092:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03ef619e79a56cd363b087a5c6f19a1a09b49040 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2026-02-17T00:58:05.444 INFO:tasks.workunit.client.0.trial092.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T00:58:05.448 INFO:tasks.workunit.client.0.trial092.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T00:58:05.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T00:58:05.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T00:58:05.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T00:58:05.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T00:58:05.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T00:58:05.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T00:58:05.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T00:58:05.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T00:58:05.448 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/ec-error-rollforward 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none ' 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2026-02-17T00:58:05.449 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ec-error-rollforward 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ec-error-rollforward 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:58:05.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:58:05.452 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:58:05.453 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:58:05.453 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:58:05.453 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:58:05.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:58:05.454 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:58:05.454 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:58:05.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:05.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:58:05.455 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:58:05.456 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:05.456 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:58:05.457 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:58:05.457 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-17T00:58:05.458 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:58:05.458 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:05.458 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:05.458 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.98784 2026-02-17T00:58:05.459 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:58:05.459 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:58:05.459 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ec-error-rollforward 2026-02-17T00:58:05.460 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T00:58:05.460 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:05.460 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:05.461 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.98784 2026-02-17T00:58:05.462 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T00:58:05.462 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T00:58:05.462 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T00:58:05.462 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T00:58:05.462 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2026-02-17T00:58:05.462 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2026-02-17T00:58:05.462 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2026-02-17T00:58:05.462 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2026-02-17T00:58:05.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ec-error-rollforward 2026-02-17T00:58:05.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T00:58:05.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T00:58:05.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T00:58:05.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ec-error-rollforward/a 2026-02-17T00:58:05.463 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2026-02-17T00:58:05.480 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T00:58:05.480 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:05.480 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:05.480 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:05.480 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:05.480 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:05.481 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:05.481 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T00:58:05.503 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T00:58:05.505 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T00:58:05.505 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:58:05.505 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:58:05.505 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T00:58:05.505 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T00:58:05.505 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:58:05.505 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:58:05.505 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:58:05.506 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:58:05.506 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:05.506 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:05.506 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.98784/ceph-mon.a.asok 2026-02-17T00:58:05.507 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:58:05.507 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.98784/ceph-mon.a.asok config get fsid 2026-02-17T00:58:05.549 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T00:58:05.550 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:58:05.550 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:58:05.550 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T00:58:05.550 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T00:58:05.550 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:58:05.550 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:58:05.550 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:58:05.550 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:58:05.550 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:05.550 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:05.551 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.98784/ceph-mon.a.asok 2026-02-17T00:58:05.551 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:58:05.551 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.98784/ceph-mon.a.asok config get mon_host 2026-02-17T00:58:05.593 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2026-02-17T00:58:05.593 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ec-error-rollforward 2026-02-17T00:58:05.593 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T00:58:05.593 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T00:58:05.593 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T00:58:05.593 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ec-error-rollforward/x 2026-02-17T00:58:05.593 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T00:58:05.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T00:58:05.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:05.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:05.691 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:05.691 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:05.691 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:05.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:05.691 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:58:05.692 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/0 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:05.707 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:58:05.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/0 2026-02-17T00:58:05.709 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:58:05.709 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d4e9958a-29ad-4a09-aa60-1e25a8953f8d 2026-02-17T00:58:05.710 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 d4e9958a-29ad-4a09-aa60-1e25a8953f8d' 2026-02-17T00:58:05.710 INFO:tasks.workunit.client.0.trial092.stdout:add osd0 d4e9958a-29ad-4a09-aa60-1e25a8953f8d 2026-02-17T00:58:05.710 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:58:05.718 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAdvZNp/qXZKhAAxLStEKr7TTqbt0Drt91bwg== 2026-02-17T00:58:05.718 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAdvZNp/qXZKhAAxLStEKr7TTqbt0Drt91bwg=="}' 2026-02-17T00:58:05.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d4e9958a-29ad-4a09-aa60-1e25a8953f8d -i td/ec-error-rollforward/0/new.json 2026-02-17T00:58:05.818 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:05.824 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/0/new.json 2026-02-17T00:58:05.825 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAdvZNp/qXZKhAAxLStEKr7TTqbt0Drt91bwg== --osd-uuid d4e9958a-29ad-4a09-aa60-1e25a8953f8d 2026-02-17T00:58:05.839 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:05.838+0000 7f4bc9e15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:05.840 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:05.839+0000 7f4bc9e15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:05.841 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:05.840+0000 7f4bc9e15780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:05.841 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:05.840+0000 7f4bc9e15780 -1 bdev(0x2506c00 td/ec-error-rollforward/0/block) open stat got: (1) Operation not permitted 2026-02-17T00:58:05.841 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:05.840+0000 7f4bc9e15780 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2026-02-17T00:58:06.281 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2026-02-17T00:58:06.281 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:58:06.281 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T00:58:06.282 INFO:tasks.workunit.client.0.trial092.stdout:adding osd0 key to auth repository 2026-02-17T00:58:06.282 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:58:06.383 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T00:58:06.383 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:58:06.384 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:06.384 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:58:06.384 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:58:06.385 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:58:06.396 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:06.395+0000 7ffaed20f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:06.398 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:06.397+0000 7ffaed20f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:06.398 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:06.398+0000 7ffaed20f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:06.478 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T00:58:06.478 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:06.478 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:58:06.478 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:06.478 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:06.478 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:06.479 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:06.479 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:06.479 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:06.479 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:58:06.574 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:06.588 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:06.588+0000 7ffaed20f780 -1 Falling back to public interface 2026-02-17T00:58:06.946 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:06.944+0000 7ffaed20f780 -1 osd.0 0 log_to_monitors true 2026-02-17T00:58:07.575 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:07.575 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:07.575 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:07.575 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:58:07.575 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:07.575 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:58:07.672 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2411685103,v1:127.0.0.1:6801/2411685103] [v2:127.0.0.1:6802/2411685103,v1:127.0.0.1:6803/2411685103] exists,up d4e9958a-29ad-4a09-aa60-1e25a8953f8d 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/1 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:07.673 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/1 2026-02-17T00:58:07.674 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:58:07.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b59b9196-a23b-4c66-a942-a3ec668a0360 2026-02-17T00:58:07.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b59b9196-a23b-4c66-a942-a3ec668a0360' 2026-02-17T00:58:07.675 INFO:tasks.workunit.client.0.trial092.stdout:add osd1 b59b9196-a23b-4c66-a942-a3ec668a0360 2026-02-17T00:58:07.675 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:58:07.685 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAfvZNpWSTQKBAAdNwRhvFOBosOQdZatk1xcA== 2026-02-17T00:58:07.685 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAfvZNpWSTQKBAAdNwRhvFOBosOQdZatk1xcA=="}' 2026-02-17T00:58:07.685 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b59b9196-a23b-4c66-a942-a3ec668a0360 -i td/ec-error-rollforward/1/new.json 2026-02-17T00:58:07.786 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:07.792 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/1/new.json 2026-02-17T00:58:07.793 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAfvZNpWSTQKBAAdNwRhvFOBosOQdZatk1xcA== --osd-uuid b59b9196-a23b-4c66-a942-a3ec668a0360 2026-02-17T00:58:07.808 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:07.807+0000 7f579702f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:07.810 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:07.809+0000 7f579702f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:07.810 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:07.810+0000 7f579702f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:07.811 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:07.810+0000 7f579702f780 -1 bdev(0x288ec00 td/ec-error-rollforward/1/block) open stat got: (1) Operation not permitted 2026-02-17T00:58:07.811 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:07.810+0000 7f579702f780 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2026-02-17T00:58:08.138 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2026-02-17T00:58:08.138 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:58:08.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T00:58:08.139 INFO:tasks.workunit.client.0.trial092.stdout:adding osd1 key to auth repository 2026-02-17T00:58:08.140 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:58:08.473 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T00:58:08.473 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:58:08.475 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:08.475 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:58:08.475 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:58:08.475 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:58:08.486 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:08.485+0000 7f47a0821780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:08.487 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:08.486+0000 7f47a0821780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:08.488 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:08.487+0000 7f47a0821780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:08.655 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:08.654+0000 7f47a0821780 -1 Falling back to public interface 2026-02-17T00:58:08.698 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T00:58:08.698 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:08.698 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:58:08.699 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:08.699 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:08.699 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:08.699 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:08.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:08.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:08.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:58:08.928 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:08.958 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:08.957+0000 7f47a0821780 -1 osd.1 0 log_to_monitors true 2026-02-17T00:58:09.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:09.929 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:09.930 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:09.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:58:09.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:09.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:58:10.156 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4063197249,v1:127.0.0.1:6811/4063197249] [v2:127.0.0.1:6812/4063197249,v1:127.0.0.1:6813/4063197249] exists,up b59b9196-a23b-4c66-a942-a3ec668a0360 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/2 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T00:58:10.157 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:58:10.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/2 2026-02-17T00:58:10.159 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:58:10.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5f90399a-132b-4fde-bdae-2027bef6ea84 2026-02-17T00:58:10.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 5f90399a-132b-4fde-bdae-2027bef6ea84' 2026-02-17T00:58:10.160 INFO:tasks.workunit.client.0.trial092.stdout:add osd2 5f90399a-132b-4fde-bdae-2027bef6ea84 2026-02-17T00:58:10.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:58:10.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAivZNpO/ITChAAGOnyepBiAf76hpj1Ar/Xug== 2026-02-17T00:58:10.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAivZNpO/ITChAAGOnyepBiAf76hpj1Ar/Xug=="}' 2026-02-17T00:58:10.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5f90399a-132b-4fde-bdae-2027bef6ea84 -i td/ec-error-rollforward/2/new.json 2026-02-17T00:58:10.396 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T00:58:10.404 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/2/new.json 2026-02-17T00:58:10.405 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAivZNpO/ITChAAGOnyepBiAf76hpj1Ar/Xug== --osd-uuid 5f90399a-132b-4fde-bdae-2027bef6ea84 2026-02-17T00:58:10.419 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:10.418+0000 7f9844285780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:10.420 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:10.419+0000 7f9844285780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:10.421 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:10.420+0000 7f9844285780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:10.421 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:10.420+0000 7f9844285780 -1 bdev(0x3564c00 td/ec-error-rollforward/2/block) open stat got: (1) Operation not permitted 2026-02-17T00:58:10.422 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:10.421+0000 7f9844285780 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2026-02-17T00:58:10.743 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2026-02-17T00:58:10.744 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:58:10.744 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T00:58:10.744 INFO:tasks.workunit.client.0.trial092.stdout:adding osd2 key to auth repository 2026-02-17T00:58:10.744 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:58:11.072 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:58:11.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T00:58:11.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:11.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:58:11.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:58:11.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:58:11.086 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:11.085+0000 7fd7e8a29780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:11.088 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:11.087+0000 7fd7e8a29780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:11.088 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:11.088+0000 7fd7e8a29780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:11.261 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:11.261+0000 7fd7e8a29780 -1 Falling back to public interface 2026-02-17T00:58:11.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T00:58:11.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:11.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:58:11.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:11.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:11.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:11.299 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:11.299 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:11.300 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:11.300 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:58:11.529 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:11.581 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:11.581+0000 7fd7e8a29780 -1 osd.2 0 log_to_monitors true 2026-02-17T00:58:12.530 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:12.530 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:12.531 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:12.531 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:58:12.531 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:12.531 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:58:12.755 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1735210658,v1:127.0.0.1:6819/1735210658] [v2:127.0.0.1:6820/1735210658,v1:127.0.0.1:6821/1735210658] exists,up 5f90399a-132b-4fde-bdae-2027bef6ea84 2026-02-17T00:58:12.756 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:12.756 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:12.756 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:12.756 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2026-02-17T00:58:12.756 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-17T00:58:12.756 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:58:12.756 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T00:58:12.756 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:58:12.756 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/3 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:12.757 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/3 2026-02-17T00:58:12.758 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:58:12.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=d1b44400-ebe0-45b9-9c51-80b93e2ffa8e 2026-02-17T00:58:12.759 INFO:tasks.workunit.client.0.trial092.stdout:add osd3 d1b44400-ebe0-45b9-9c51-80b93e2ffa8e 2026-02-17T00:58:12.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 d1b44400-ebe0-45b9-9c51-80b93e2ffa8e' 2026-02-17T00:58:12.759 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:58:12.768 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAkvZNp8QzILRAAFdDEJpKWcv6EPOf3izVxoQ== 2026-02-17T00:58:12.768 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAkvZNp8QzILRAAFdDEJpKWcv6EPOf3izVxoQ=="}' 2026-02-17T00:58:12.768 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new d1b44400-ebe0-45b9-9c51-80b93e2ffa8e -i td/ec-error-rollforward/3/new.json 2026-02-17T00:58:12.998 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T00:58:13.006 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/3/new.json 2026-02-17T00:58:13.007 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAkvZNp8QzILRAAFdDEJpKWcv6EPOf3izVxoQ== --osd-uuid d1b44400-ebe0-45b9-9c51-80b93e2ffa8e 2026-02-17T00:58:13.021 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:13.021+0000 7f9b41a87780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:13.022 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:13.022+0000 7f9b41a87780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:13.023 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:13.023+0000 7f9b41a87780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:13.023 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:13.023+0000 7f9b41a87780 -1 bdev(0x36b4c00 td/ec-error-rollforward/3/block) open stat got: (1) Operation not permitted 2026-02-17T00:58:13.023 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:13.023+0000 7f9b41a87780 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2026-02-17T00:58:13.350 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2026-02-17T00:58:13.350 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:58:13.351 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T00:58:13.351 INFO:tasks.workunit.client.0.trial092.stdout:adding osd3 key to auth repository 2026-02-17T00:58:13.351 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:58:13.684 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T00:58:13.684 INFO:tasks.workunit.client.0.trial092.stdout:start osd.3 2026-02-17T00:58:13.684 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:13.684 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:58:13.684 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:58:13.684 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:58:13.697 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:13.697+0000 7fdc4a034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:13.698 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:13.699+0000 7fdc4a034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:13.699 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:13.700+0000 7fdc4a034780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:13.819 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:13.819+0000 7fdc4a034780 -1 Falling back to public interface 2026-02-17T00:58:13.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T00:58:13.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:13.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T00:58:13.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:13.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:13.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:13.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:13.909 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:13.910 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:13.910 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T00:58:14.107 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:14.107+0000 7fdc4a034780 -1 osd.3 0 log_to_monitors true 2026-02-17T00:58:14.138 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:15.140 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:15.140 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:15.140 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:15.141 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:58:15.141 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:15.141 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T00:58:15.363 INFO:tasks.workunit.client.0.trial092.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/742485647,v1:127.0.0.1:6827/742485647] [v2:127.0.0.1:6828/742485647,v1:127.0.0.1:6829/742485647] exists,up d1b44400-ebe0-45b9-9c51-80b93e2ffa8e 2026-02-17T00:58:15.363 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:15.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:15.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:15.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-17T00:58:15.609 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2026-02-17T00:58:16.002 INFO:tasks.workunit.client.0.trial092.stderr:pool 'ec' already exists 2026-02-17T00:58:16.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2026-02-17T00:58:16.640 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2026-02-17T00:58:16.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 102652 2026-02-17T00:58:16.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=104622 2026-02-17T00:58:16.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2026-02-17T00:58:16.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2026-02-17T00:58:17.644 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 104643' 2026-02-17T00:58:17.644 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2026-02-17T00:58:17.644 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 104644' 2026-02-17T00:58:17.644 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2026-02-17T00:58:17.644 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 104645' 2026-02-17T00:58:17.644 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2026-02-17T00:58:17.644 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2026-02-17T00:58:18.644 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2026-02-17T00:58:18.645 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:58:18.645 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:58:18.645 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:58:18.645 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:58:18.645 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:58:18.755 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:58:18.755 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 104622 104643 104644 104645 2026-02-17T00:58:18.755 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2026-02-17T00:58:18.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2026-02-17T00:58:18.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/0 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:18.759 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:58:18.760 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T00:58:18.760 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:58:18.760 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:18.760 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:18.760 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:18.760 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:18.760 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:18.760 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:18.760 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:18.760 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:18.761 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T00:58:18.761 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T00:58:18.761 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:18.761 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:18.761 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:18.761 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:18.761 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:58:18.761 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:58:18.761 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/0 2026-02-17T00:58:18.761 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T00:58:18.762 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:58:18.763 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:18.763 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/0/whoami 2026-02-17T00:58:18.763 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T00:58:18.763 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:58:18.763 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:58:18.763 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:58:18.772 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:18.772+0000 7f88c9dfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:18.773 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:18.773+0000 7f88c9dfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:18.774 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:18.774+0000 7f88c9dfd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:18.912 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:18.912+0000 7f88c9dfd780 -1 Falling back to public interface 2026-02-17T00:58:18.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T00:58:18.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:18.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:58:18.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:18.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:18.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:18.985 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:18.986 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:18.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:18.987 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:58:19.210 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:19.210+0000 7f88c9dfd780 -1 osd.0 24 log_to_monitors true 2026-02-17T00:58:19.214 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2411685103,v1:127.0.0.1:6801/2411685103] [v2:127.0.0.1:6802/2411685103,v1:127.0.0.1:6803/2411685103] exists,up d4e9958a-29ad-4a09-aa60-1e25a8953f8d 2026-02-17T00:58:19.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:19.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:19.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/1 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:19.215 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/1 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:19.216 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/1/whoami 2026-02-17T00:58:19.217 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T00:58:19.217 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:58:19.217 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:58:19.218 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:58:19.230 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:19.230+0000 7f44ff208780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:19.231 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:19.232+0000 7f44ff208780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:19.232 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:19.232+0000 7f44ff208780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:19.357 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:19.357+0000 7f44ff208780 -1 Falling back to public interface 2026-02-17T00:58:19.445 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T00:58:19.445 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:19.445 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:58:19.446 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:19.446 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:19.446 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:19.446 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:19.446 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:19.447 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:19.447 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:58:19.666 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:19.666+0000 7f44ff208780 -1 osd.1 24 log_to_monitors true 2026-02-17T00:58:19.673 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 9 up_thru 22 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4063197249,v1:127.0.0.1:6811/4063197249] [v2:127.0.0.1:6812/4063197249,v1:127.0.0.1:6813/4063197249] exists,up b59b9196-a23b-4c66-a942-a3ec668a0360 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/2 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:19.674 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/2 2026-02-17T00:58:19.675 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T00:58:19.676 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:58:19.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:19.676 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/2/whoami 2026-02-17T00:58:19.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T00:58:19.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:58:19.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:58:19.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:58:19.690 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:19.690+0000 7f455b608780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:19.691 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:19.691+0000 7f455b608780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:19.692 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:19.692+0000 7f455b608780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:19.831 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:19.831+0000 7f455b608780 -1 Falling back to public interface 2026-02-17T00:58:19.902 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T00:58:19.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:19.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:58:19.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:19.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:19.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:19.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:19.903 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:19.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:19.903 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:58:20.133 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:20.133+0000 7f455b608780 -1 osd.2 23 log_to_monitors true 2026-02-17T00:58:20.140 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:21.141 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:21.142 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:21.142 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:58:21.142 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:21.143 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:21.143 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:58:21.380 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 34 up_thru 0 down_at 28 last_clean_interval [13,23) [v2:127.0.0.1:6818/2870604957,v1:127.0.0.1:6819/2870604957] [v2:127.0.0.1:6820/2870604957,v1:127.0.0.1:6821/2870604957] exists,up 5f90399a-132b-4fde-bdae-2027bef6ea84 2026-02-17T00:58:21.385 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:21.386 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:21.386 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:21.386 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2026-02-17T00:58:21.386 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T00:58:21.386 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T00:58:21.386 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T00:58:21.386 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T00:58:21.386 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/3 2026-02-17T00:58:21.386 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T00:58:21.386 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:21.387 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T00:58:21.388 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T00:58:21.389 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/3 2026-02-17T00:58:21.389 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T00:58:21.389 INFO:tasks.workunit.client.0.trial092.stdout:start osd.3 2026-02-17T00:58:21.390 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=59911d24-3a01-4464-9929-a34189fa6371 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.98784/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:21.390 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/3/whoami 2026-02-17T00:58:21.390 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T00:58:21.390 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T00:58:21.390 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T00:58:21.390 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T00:58:21.395 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:21.396+0000 7ff295e62780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:21.397 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:21.397+0000 7ff295e62780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:21.398 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:21.398+0000 7ff295e62780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:21.579 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:21.579+0000 7ff295e62780 -1 Falling back to public interface 2026-02-17T00:58:21.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T00:58:21.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:21.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T00:58:21.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:21.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:21.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:21.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:21.613 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:21.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:21.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T00:58:21.842 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:21.929 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:21.930+0000 7ff295e62780 -1 osd.3 24 log_to_monitors true 2026-02-17T00:58:22.844 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:22.844 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:22.844 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:22.845 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:58:22.845 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:22.845 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T00:58:23.069 INFO:tasks.workunit.client.0.trial092.stdout:osd.3 up in weight 1 up_from 38 up_thru 0 down_at 28 last_clean_interval [18,24) [v2:127.0.0.1:6826/1039057096,v1:127.0.0.1:6827/1039057096] [v2:127.0.0.1:6828/1039057096,v1:127.0.0.1:6829/1039057096] exists,up d1b44400-ebe0-45b9-9c51-80b93e2ffa8e 2026-02-17T00:58:23.070 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:23.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:23.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:23.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2026-02-17T00:58:23.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T00:58:23.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T00:58:23.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T00:58:23.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T00:58:23.071 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T00:58:23.071 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T00:58:23.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T00:58:23.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T00:58:23.072 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T00:58:23.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T00:58:23.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T00:58:23.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T00:58:23.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T00:58:23.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T00:58:23.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T00:58:23.376 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T00:58:23.376 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T00:58:23.376 INFO:tasks.workunit.client.0.trial092.stderr:2 2026-02-17T00:58:23.377 INFO:tasks.workunit.client.0.trial092.stderr:3' 2026-02-17T00:58:23.377 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T00:58:23.377 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:58:23.377 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T00:58:23.437 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=115964116995 2026-02-17T00:58:23.437 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 115964116995 2026-02-17T00:58:23.437 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-115964116995' 2026-02-17T00:58:23.437 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:58:23.437 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T00:58:23.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986179 2026-02-17T00:58:23.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986179 2026-02-17T00:58:23.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-115964116995 1-133143986179' 2026-02-17T00:58:23.502 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:58:23.503 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T00:58:23.563 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888067 2026-02-17T00:58:23.563 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888067 2026-02-17T00:58:23.563 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-115964116995 1-133143986179 2-146028888067' 2026-02-17T00:58:23.564 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T00:58:23.564 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T00:58:23.625 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-17T00:58:23.625 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-17T00:58:23.625 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-115964116995 1-133143986179 2-146028888067 3-163208757251' 2026-02-17T00:58:23.625 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:58:23.626 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-115964116995 2026-02-17T00:58:23.626 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:58:23.627 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T00:58:23.627 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-115964116995 2026-02-17T00:58:23.627 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:58:23.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=115964116995 2026-02-17T00:58:23.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 115964116995' 2026-02-17T00:58:23.629 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 115964116995 2026-02-17T00:58:23.629 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T00:58:23.856 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 115964116995 -lt 115964116995 2026-02-17T00:58:23.856 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:58:23.856 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-133143986179 2026-02-17T00:58:23.856 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:58:23.857 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T00:58:23.858 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-133143986179 2026-02-17T00:58:23.858 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:58:23.859 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=133143986179 2026-02-17T00:58:23.859 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 133143986179' 2026-02-17T00:58:23.859 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 133143986179 2026-02-17T00:58:23.859 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T00:58:24.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 133143986179 -lt 133143986179 2026-02-17T00:58:24.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:58:24.083 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-146028888067 2026-02-17T00:58:24.083 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:58:24.083 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T00:58:24.084 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-146028888067 2026-02-17T00:58:24.084 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:58:24.086 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=146028888067 2026-02-17T00:58:24.086 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 146028888067' 2026-02-17T00:58:24.086 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 146028888067 2026-02-17T00:58:24.087 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T00:58:24.310 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 146028888067 -lt 146028888067 2026-02-17T00:58:24.310 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T00:58:24.310 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-163208757251 2026-02-17T00:58:24.311 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T00:58:24.312 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T00:58:24.312 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-163208757251 2026-02-17T00:58:24.312 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T00:58:24.313 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=163208757251 2026-02-17T00:58:24.313 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.3 seq 163208757251 2026-02-17T00:58:24.313 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 163208757251' 2026-02-17T00:58:24.314 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T00:58:24.535 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-17T00:58:24.535 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T00:58:24.535 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:58:24.535 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:58:24.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-17T00:58:24.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T00:58:24.853 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T00:58:24.853 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T00:58:24.853 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T00:58:24.853 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T00:58:24.853 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T00:58:24.854 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T00:58:25.079 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-17T00:58:25.080 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T00:58:25.080 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T00:58:25.081 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T00:58:25.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-17T00:58:25.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T00:58:25.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T00:58:25.397 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2026-02-17T00:58:25.398 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-17T00:58:25.398 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:58:25.398 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T00:58:25.398 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:58:25.398 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:58:25.398 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:58:25.398 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:58:25.398 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:58:25.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:58:25.505 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:58:25.506 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:58:25.506 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:58:25.508 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:58:25.508 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:58:25.508 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:58:25.509 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:25.509 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:58:25.509 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:58:25.510 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:25.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:58:25.511 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:58:25.511 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-17T00:58:25.519 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:58:25.519 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:25.520 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:25.520 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.98784 2026-02-17T00:58:25.521 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:58:25.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:58:25.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T00:58:25.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/ec-error-rollforward 0 2026-02-17T00:58:25.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-17T00:58:25.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T00:58:25.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T00:58:25.522 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:58:25.522 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:58:25.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:58:25.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:58:25.523 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:58:25.523 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:58:25.523 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:58:25.524 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:58:25.524 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:58:25.525 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:58:25.525 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:58:25.525 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:58:25.526 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:25.526 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:58:25.526 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:58:25.526 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:25.527 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:58:25.528 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T00:58:25.528 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-17T00:58:25.529 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:58:25.529 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:25.529 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.98784 2026-02-17T00:58:25.529 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.98784 2026-02-17T00:58:25.530 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:58:25.531 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:58:25.531 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T00:58:25.531 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T00:58:25.531 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T00:58:25.596 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2026-02-17T00:58:25.596 DEBUG:teuthology.orchestra.run.trial092:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03ef619e79a56cd363b087a5c6f19a1a09b49040 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2026-02-17T00:58:25.657 INFO:tasks.workunit.client.0.trial092.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T00:58:25.661 INFO:tasks.workunit.client.0.trial092.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T00:58:25.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T00:58:25.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T00:58:25.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T00:58:25.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T00:58:25.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T00:58:25.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T00:58:25.661 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T00:58:25.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T00:58:25.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bench 2026-02-17T00:58:25.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2026-02-17T00:58:25.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2026-02-17T00:58:25.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2026-02-17T00:58:25.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2026-02-17T00:58:25.662 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2026-02-17T00:58:25.662 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2026-02-17T00:58:25.664 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=8a7fface-4f91-42e9-8103-0846768c0285 --auth-supported=none ' 2026-02-17T00:58:25.664 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2026-02-17T00:58:25.664 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-17T00:58:25.664 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bench 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bench 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:58:25.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:58:25.666 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:58:25.666 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:58:25.667 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:58:25.667 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:58:25.667 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:58:25.667 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:58:25.668 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:58:25.668 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:58:25.668 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:58:25.668 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:25.669 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:58:25.669 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:58:25.669 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:25.669 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:58:25.670 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:58:25.670 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-17T00:58:25.671 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:58:25.671 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:25.671 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.107330 2026-02-17T00:58:25.671 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.107330 2026-02-17T00:58:25.672 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:58:25.672 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:58:25.672 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bench 2026-02-17T00:58:25.673 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T00:58:25.673 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:25.673 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.107330 2026-02-17T00:58:25.673 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.107330 2026-02-17T00:58:25.674 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T00:58:25.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T00:58:25.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T00:58:25.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T00:58:25.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2026-02-17T00:58:25.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2026-02-17T00:58:25.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2026-02-17T00:58:25.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2026-02-17T00:58:25.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bench 2026-02-17T00:58:25.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T00:58:25.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T00:58:25.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T00:58:25.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bench/a 2026-02-17T00:58:25.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2026-02-17T00:58:25.692 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T00:58:25.692 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:25.692 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:25.693 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:25.693 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:25.693 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.107330 2026-02-17T00:58:25.693 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.107330/$cluster-$name.asok' 2026-02-17T00:58:25.693 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.107330/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T00:58:25.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T00:58:25.719 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T00:58:25.720 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:58:25.720 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:58:25.720 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T00:58:25.720 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T00:58:25.720 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:58:25.720 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:58:25.720 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:58:25.720 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:58:25.720 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:25.720 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.107330 2026-02-17T00:58:25.721 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.107330/ceph-mon.a.asok 2026-02-17T00:58:25.721 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:58:25.721 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.107330/ceph-mon.a.asok config get fsid 2026-02-17T00:58:25.764 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T00:58:25.764 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:58:25.764 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:58:25.764 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T00:58:25.764 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T00:58:25.765 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:58:25.765 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:58:25.765 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:58:25.765 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:58:25.765 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:25.765 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.107330 2026-02-17T00:58:25.765 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.107330/ceph-mon.a.asok 2026-02-17T00:58:25.765 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:58:25.765 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.107330/ceph-mon.a.asok config get mon_host 2026-02-17T00:58:25.805 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2026-02-17T00:58:25.805 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bench 2026-02-17T00:58:25.806 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T00:58:25.806 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T00:58:25.806 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T00:58:25.806 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bench/x 2026-02-17T00:58:25.806 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T00:58:25.903 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T00:58:25.903 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:25.903 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:25.904 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:25.904 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:25.904 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.107330 2026-02-17T00:58:25.904 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.107330/$cluster-$name.asok' 2026-02-17T00:58:25.904 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:58:25.904 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.107330/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:58:25.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2026-02-17T00:58:25.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bench 2026-02-17T00:58:25.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bench/0 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=8a7fface-4f91-42e9-8103-0846768c0285 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:58:25.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.107330 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.107330/$cluster-$name.asok' 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.107330/$cluster-$name.asok' 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:58:25.923 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2026-02-17T00:58:25.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2026-02-17T00:58:25.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:25.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:25.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:25.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:25.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:58:25.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:58:25.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bench/0 2026-02-17T00:58:25.924 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:58:25.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=cbdf8018-a353-444f-801f-12484314e4b1 2026-02-17T00:58:25.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 cbdf8018-a353-444f-801f-12484314e4b1' 2026-02-17T00:58:25.925 INFO:tasks.workunit.client.0.trial092.stdout:add osd0 cbdf8018-a353-444f-801f-12484314e4b1 2026-02-17T00:58:25.925 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:58:25.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQAxvZNpaNtrNxAAj9PTwV//QBn8oHc0Xnsuaw== 2026-02-17T00:58:25.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQAxvZNpaNtrNxAAj9PTwV//QBn8oHc0Xnsuaw=="}' 2026-02-17T00:58:25.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new cbdf8018-a353-444f-801f-12484314e4b1 -i td/osd-bench/0/new.json 2026-02-17T00:58:26.030 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:26.036 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bench/0/new.json 2026-02-17T00:58:26.037 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=8a7fface-4f91-42e9-8103-0846768c0285 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.107330/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAxvZNpaNtrNxAAj9PTwV//QBn8oHc0Xnsuaw== --osd-uuid cbdf8018-a353-444f-801f-12484314e4b1 2026-02-17T00:58:26.052 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:26.052+0000 7f5858dd4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:26.054 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:26.053+0000 7f5858dd4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:26.055 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:26.054+0000 7f5858dd4780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:26.055 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:26.054+0000 7f5858dd4780 -1 bdev(0x330ac00 td/osd-bench/0/block) open stat got: (1) Operation not permitted 2026-02-17T00:58:26.055 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:26.054+0000 7f5858dd4780 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2026-02-17T00:58:26.507 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bench/0/keyring 2026-02-17T00:58:26.508 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:58:26.508 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T00:58:26.508 INFO:tasks.workunit.client.0.trial092.stdout:adding osd0 key to auth repository 2026-02-17T00:58:26.509 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:58:26.610 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T00:58:26.611 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:58:26.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=8a7fface-4f91-42e9-8103-0846768c0285 --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.107330/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:26.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:58:26.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:58:26.611 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:58:26.625 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:26.625+0000 7fdc03e52780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:26.627 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:26.626+0000 7fdc03e52780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:26.627 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:26.627+0000 7fdc03e52780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:26.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T00:58:26.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:26.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:58:26.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:26.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:26.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:26.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:26.709 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:26.709 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:26.709 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:58:26.803 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:26.832 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:26.831+0000 7fdc03e52780 -1 Falling back to public interface 2026-02-17T00:58:27.173 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:27.172+0000 7fdc03e52780 -1 osd.0 0 log_to_monitors true 2026-02-17T00:58:27.804 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:27.804 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:27.804 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:27.805 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:58:27.805 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:27.805 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:58:27.903 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/652038261,v1:127.0.0.1:6801/652038261] [v2:127.0.0.1:6802/652038261,v1:127.0.0.1:6803/652038261] exists,up cbdf8018-a353-444f-801f-12484314e4b1 2026-02-17T00:58:27.904 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:27.904 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:27.904 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:27.904 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2026-02-17T00:58:27.904 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2026-02-17T00:58:27.911 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2026-02-17T00:58:27.912 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2026-02-17T00:58:27.912 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2026-02-17T00:58:27.919 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2026-02-17T00:58:27.920 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2026-02-17T00:58:27.920 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2026-02-17T00:58:27.927 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2026-02-17T00:58:27.927 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2026-02-17T00:58:27.927 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2026-02-17T00:58:27.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2026-02-17T00:58:27.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2026-02-17T00:58:27.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-17T00:58:27.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-17T00:58:27.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_max_block_size 2026-02-17T00:58:27.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-17T00:58:27.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-17T00:58:27.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 1024 67108865 2026-02-17T00:58:27.986 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-17T00:58:27.986 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-17T00:58:27.986 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2026-02-17T00:58:27.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-17T00:58:27.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2026-02-17T00:58:27.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2026-02-17T00:58:27.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2026-02-17T00:58:27.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-17T00:58:27.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-17T00:58:27.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=bench_small_size_max_iops 2026-02-17T00:58:27.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-17T00:58:27.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-17T00:58:27.989 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3072001 1024 2026-02-17T00:58:28.040 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-17T00:58:28.040 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-17T00:58:28.041 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2026-02-17T00:58:28.042 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-17T00:58:28.042 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2026-02-17T00:58:28.042 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2026-02-17T00:58:28.042 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2026-02-17T00:58:28.042 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-17T00:58:28.043 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-17T00:58:28.043 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_large_size_max_throughput 2026-02-17T00:58:28.043 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-17T00:58:28.043 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-17T00:58:28.043 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2026-02-17T00:58:28.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-17T00:58:28.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-17T00:58:28.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2026-02-17T00:58:28.094 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-17T00:58:28.094 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2026-02-17T00:58:29.737 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:58:29.737 INFO:tasks.workunit.client.0.trial092.stdout: "bytes_written": 1073741824, 2026-02-17T00:58:29.737 INFO:tasks.workunit.client.0.trial092.stdout: "blocksize": 4194304, 2026-02-17T00:58:29.737 INFO:tasks.workunit.client.0.trial092.stdout: "elapsed_sec": 0.74704086300000005, 2026-02-17T00:58:29.737 INFO:tasks.workunit.client.0.trial092.stdout: "bytes_per_sec": 1437326761.0663488, 2026-02-17T00:58:29.738 INFO:tasks.workunit.client.0.trial092.stdout: "iops": 342.6854040780899 2026-02-17T00:58:29.738 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:58:29.743 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2026-02-17T00:58:29.801 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:58:29.802 INFO:tasks.workunit.client.0.trial092.stdout: "bytes_written": 10, 2026-02-17T00:58:29.802 INFO:tasks.workunit.client.0.trial092.stdout: "blocksize": 14456, 2026-02-17T00:58:29.802 INFO:tasks.workunit.client.0.trial092.stdout: "elapsed_sec": 0.000244102, 2026-02-17T00:58:29.802 INFO:tasks.workunit.client.0.trial092.stdout: "bytes_per_sec": 40966.481225061652, 2026-02-17T00:58:29.802 INFO:tasks.workunit.client.0.trial092.stdout: "iops": 2.8338739087618743 2026-02-17T00:58:29.802 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:58:29.807 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2026-02-17T00:58:29.861 INFO:tasks.workunit.client.0.trial092.stdout:{ 2026-02-17T00:58:29.861 INFO:tasks.workunit.client.0.trial092.stdout: "bytes_written": 1, 2026-02-17T00:58:29.861 INFO:tasks.workunit.client.0.trial092.stdout: "blocksize": 14456, 2026-02-17T00:58:29.861 INFO:tasks.workunit.client.0.trial092.stdout: "elapsed_sec": 0.00015679100000000001, 2026-02-17T00:58:29.861 INFO:tasks.workunit.client.0.trial092.stdout: "bytes_per_sec": 6377.9170998335358, 2026-02-17T00:58:29.861 INFO:tasks.workunit.client.0.trial092.stdout: "iops": 0.44119515079091975 2026-02-17T00:58:29.861 INFO:tasks.workunit.client.0.trial092.stdout:} 2026-02-17T00:58:29.865 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2026-02-17T00:58:29.866 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-17T00:58:29.866 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:58:29.866 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-17T00:58:29.866 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:58:29.866 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:58:29.866 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:58:29.866 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:58:29.866 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:58:29.972 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:58:29.973 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:58:29.973 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:58:29.974 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:58:29.975 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:58:29.975 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:58:29.975 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:58:29.976 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:29.976 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:58:29.977 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:58:29.977 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:29.978 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:58:29.979 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:58:29.979 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-17T00:58:30.006 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:58:30.007 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:30.007 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.107330 2026-02-17T00:58:30.007 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.107330 2026-02-17T00:58:30.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:58:30.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:58:30.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: code=0 2026-02-17T00:58:30.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bench 0 2026-02-17T00:58:30.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-17T00:58:30.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-17T00:58:30.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-17T00:58:30.009 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:58:30.009 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:58:30.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:58:30.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:58:30.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:58:30.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:58:30.010 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:58:30.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:58:30.011 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:58:30.011 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:58:30.011 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:58:30.012 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:58:30.013 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:30.013 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:58:30.013 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:58:30.013 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:30.014 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:58:30.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T00:58:30.015 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-17T00:58:30.016 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:58:30.016 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:30.016 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.107330 2026-02-17T00:58:30.016 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.107330 2026-02-17T00:58:30.017 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:58:30.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:58:30.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 0 2026-02-17T00:58:30.018 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T00:58:30.018 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T00:58:30.082 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2026-02-17T00:58:30.082 DEBUG:teuthology.orchestra.run.trial092:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03ef619e79a56cd363b087a5c6f19a1a09b49040 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2026-02-17T00:58:30.146 INFO:tasks.workunit.client.0.trial092.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T00:58:30.151 INFO:tasks.workunit.client.0.trial092.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T00:58:30.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: export PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T00:58:30.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2393: main: PATH=.:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2026-02-17T00:58:30.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PYTHONWARNINGS=ignore 2026-02-17T00:58:30.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PYTHONWARNINGS=ignore 2026-02-17T00:58:30.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export CEPH_CONF=/dev/null 2026-02-17T00:58:30.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: CEPH_CONF=/dev/null 2026-02-17T00:58:30.151 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: unset CEPH_ARGS 2026-02-17T00:58:30.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2398: main: local code 2026-02-17T00:58:30.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: run td/osd-bluefs-volume-ops 2026-02-17T00:58:30.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2026-02-17T00:58:30.152 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2026-02-17T00:58:30.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: set 2026-02-17T00:58:30.152 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T00:58:30.154 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: local 'funcs=TEST_bluestore 2026-02-17T00:58:30.154 INFO:tasks.workunit.client.0.trial092.stderr:TEST_bluestore2 2026-02-17T00:58:30.154 INFO:tasks.workunit.client.0.trial092.stderr:TEST_bluestore_expand' 2026-02-17T00:58:30.154 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-17T00:58:30.154 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-17T00:58:30.154 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-17T00:58:30.154 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-17T00:58:30.154 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T00:58:30.154 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T00:58:30.154 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T00:58:30.155 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T00:58:30.155 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T00:58:30.155 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T00:58:30.155 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T00:58:30.155 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T00:58:30.156 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T00:58:30.156 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T00:58:30.156 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T00:58:30.156 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T00:58:30.156 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T00:58:30.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T00:58:30.157 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T00:58:30.157 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:30.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T00:58:30.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T00:58:30.158 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T00:58:30.158 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T00:58:30.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T00:58:30.159 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T00:58:30.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T00:58:30.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:30.160 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T00:58:30.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.109301 2026-02-17T00:58:30.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T00:58:30.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T00:58:30.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-17T00:58:30.162 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T00:58:30.162 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:30.163 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T00:58:30.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.109301 2026-02-17T00:58:30.163 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T00:58:30.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-17T00:58:30.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-17T00:58:30.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T00:58:30.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-17T00:58:30.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore td/osd-bluefs-volume-ops 2026-02-17T00:58:30.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2026-02-17T00:58:30.165 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: ulimit -n 2026-02-17T00:58:30.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: local flimit=4096 2026-02-17T00:58:30.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: TEST_bluestore: '[' 4096 -lt 1536 ']' 2026-02-17T00:58:30.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: export CEPH_MON=127.0.0.1:7146 2026-02-17T00:58:30.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: CEPH_MON=127.0.0.1:7146 2026-02-17T00:58:30.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:27: TEST_bluestore: export CEPH_ARGS 2026-02-17T00:58:30.166 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: uuidgen 2026-02-17T00:58:30.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: CEPH_ARGS+='--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none ' 2026-02-17T00:58:30.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:29: TEST_bluestore: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-17T00:58:30.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2026-02-17T00:58:30.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:31: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-17T00:58:30.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-17T00:58:30.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2026-02-17T00:58:30.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:34: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2026-02-17T00:58:30.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:35: TEST_bluestore: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-17T00:58:30.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: CEPH_ARGS+='--bluestore_allocation_from_file=0 ' 2026-02-17T00:58:30.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2026-02-17T00:58:30.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-17T00:58:30.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T00:58:30.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T00:58:30.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T00:58:30.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-17T00:58:30.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-17T00:58:30.185 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T00:58:30.185 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:30.185 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:30.185 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:30.186 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:30.186 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T00:58:30.186 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T00:58:30.186 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T00:58:30.207 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T00:58:30.207 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T00:58:30.207 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:58:30.207 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:58:30.207 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T00:58:30.208 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T00:58:30.208 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:58:30.208 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:58:30.208 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:58:30.208 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:58:30.208 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:30.208 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T00:58:30.208 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.109301/ceph-mon.a.asok 2026-02-17T00:58:30.208 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:58:30.208 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.109301/ceph-mon.a.asok config get fsid 2026-02-17T00:58:30.253 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T00:58:30.254 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T00:58:30.254 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T00:58:30.254 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T00:58:30.254 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T00:58:30.254 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T00:58:30.254 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T00:58:30.254 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T00:58:30.254 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T00:58:30.254 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:30.254 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T00:58:30.254 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.109301/ceph-mon.a.asok 2026-02-17T00:58:30.255 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T00:58:30.255 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.109301/ceph-mon.a.asok config get mon_host 2026-02-17T00:58:30.296 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2026-02-17T00:58:30.296 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-17T00:58:30.296 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T00:58:30.296 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T00:58:30.297 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T00:58:30.297 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-17T00:58:30.297 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T00:58:30.392 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T00:58:30.392 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:30.392 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:30.392 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:30.392 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:30.393 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T00:58:30.393 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T00:58:30.393 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:58:30.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T00:58:30.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2026-02-17T00:58:30.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T00:58:30.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:58:30.412 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T00:58:30.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T00:58:30.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:30.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:30.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:30.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:30.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:58:30.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:58:30.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-17T00:58:30.414 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:58:30.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=acd97186-aaca-45b8-ae31-942f7123432f 2026-02-17T00:58:30.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 acd97186-aaca-45b8-ae31-942f7123432f' 2026-02-17T00:58:30.415 INFO:tasks.workunit.client.0.trial092.stdout:add osd0 acd97186-aaca-45b8-ae31-942f7123432f 2026-02-17T00:58:30.415 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:58:30.420 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA2vZNpZZkMGRAAbm3YmPoHlOPnFv2wqjsU6w== 2026-02-17T00:58:30.420 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA2vZNpZZkMGRAAbm3YmPoHlOPnFv2wqjsU6w=="}' 2026-02-17T00:58:30.420 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new acd97186-aaca-45b8-ae31-942f7123432f -i td/osd-bluefs-volume-ops/0/new.json 2026-02-17T00:58:30.521 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:30.527 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-17T00:58:30.528 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA2vZNpZZkMGRAAbm3YmPoHlOPnFv2wqjsU6w== --osd-uuid acd97186-aaca-45b8-ae31-942f7123432f 2026-02-17T00:58:30.543 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:30.542+0000 7f46771df780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:30.544 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:30.544+0000 7f46771df780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:30.545 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:30.544+0000 7f46771df780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:30.546 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:30.545+0000 7f46771df780 -1 bdev(0x42c8c00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-17T00:58:30.546 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:30.545+0000 7f46771df780 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-17T00:58:31.415 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-17T00:58:31.415 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:58:31.416 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T00:58:31.416 INFO:tasks.workunit.client.0.trial092.stdout:adding osd0 key to auth repository 2026-02-17T00:58:31.417 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:58:31.523 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T00:58:31.524 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T00:58:31.524 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:31.524 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:58:31.525 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:58:31.525 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:58:31.538 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:31.538+0000 7efe54dc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:31.540 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:31.539+0000 7efe54dc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:31.541 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:31.540+0000 7efe54dc6780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:31.620 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T00:58:31.621 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:31.621 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T00:58:31.621 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:31.621 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:31.621 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:31.621 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:31.621 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:31.622 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:31.622 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:58:31.718 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:31.791 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:31.790+0000 7efe54dc6780 -1 Falling back to public interface 2026-02-17T00:58:32.575 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:32.574+0000 7efe54dc6780 -1 osd.0 0 log_to_monitors true 2026-02-17T00:58:32.719 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:32.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:32.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:58:32.720 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:32.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:32.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:58:32.948 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:33.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:33.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:33.950 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T00:58:33.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T00:58:33.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:33.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T00:58:34.178 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3410494483,v1:127.0.0.1:6801/3410494483] [v2:127.0.0.1:6802/3410494483,v1:127.0.0.1:6803/3410494483] exists,up acd97186-aaca-45b8-ae31-942f7123432f 2026-02-17T00:58:34.178 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:34.178 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:34.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:34.179 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-17T00:58:34.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid0=110675 2026-02-17T00:58:34.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2026-02-17T00:58:34.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T00:58:34.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:58:34.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-17T00:58:34.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:58:34.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-17T00:58:34.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T00:58:34.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:34.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T00:58:34.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:58:34.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=4081cf48-22d6-40a5-8af4-1d30e1c6dfab 2026-02-17T00:58:34.183 INFO:tasks.workunit.client.0.trial092.stdout:add osd1 4081cf48-22d6-40a5-8af4-1d30e1c6dfab 2026-02-17T00:58:34.183 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 4081cf48-22d6-40a5-8af4-1d30e1c6dfab' 2026-02-17T00:58:34.183 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:58:34.193 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA6vZNpwGyHCxAA7aT/VTRW5RRj5efxc5JoNA== 2026-02-17T00:58:34.193 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA6vZNpwGyHCxAA7aT/VTRW5RRj5efxc5JoNA=="}' 2026-02-17T00:58:34.193 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 4081cf48-22d6-40a5-8af4-1d30e1c6dfab -i td/osd-bluefs-volume-ops/1/new.json 2026-02-17T00:58:34.423 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:34.431 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2026-02-17T00:58:34.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA6vZNpwGyHCxAA7aT/VTRW5RRj5efxc5JoNA== --osd-uuid 4081cf48-22d6-40a5-8af4-1d30e1c6dfab 2026-02-17T00:58:34.447 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:34.446+0000 7fb24d830780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:34.448 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:34.448+0000 7fb24d830780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:34.449 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:34.449+0000 7fb24d830780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:34.450 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:34.449+0000 7fb24d830780 -1 bdev(0x2804c00 td/osd-bluefs-volume-ops/1/block) open stat got: (1) Operation not permitted 2026-02-17T00:58:34.450 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:34.449+0000 7fb24d830780 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2026-02-17T00:58:35.133 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2026-02-17T00:58:35.133 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:58:35.133 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-17T00:58:35.134 INFO:tasks.workunit.client.0.trial092.stdout:adding osd1 key to auth repository 2026-02-17T00:58:35.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:58:35.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-17T00:58:35.450 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T00:58:35.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:35.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:58:35.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:58:35.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:58:35.464 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:35.463+0000 7f198b86a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:35.465 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:35.465+0000 7f198b86a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:35.466 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:35.465+0000 7f198b86a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:35.669 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:35.669+0000 7f198b86a780 -1 Falling back to public interface 2026-02-17T00:58:35.671 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-17T00:58:35.671 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:35.671 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T00:58:35.671 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:35.671 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:35.671 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:35.671 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:35.671 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:35.671 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:35.671 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:58:35.894 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:36.244 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:36.243+0000 7f198b86a780 -1 osd.1 0 log_to_monitors true 2026-02-17T00:58:36.895 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:36.895 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:36.896 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:36.896 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:58:36.896 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:36.896 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T00:58:37.124 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4242614390,v1:127.0.0.1:6811/4242614390] [v2:127.0.0.1:6812/4242614390,v1:127.0.0.1:6813/4242614390] exists,up 4081cf48-22d6-40a5-8af4-1d30e1c6dfab 2026-02-17T00:58:37.125 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:37.125 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:37.125 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:37.125 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid1=112910 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-17T00:58:37.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:37.128 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:58:37.128 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T00:58:37.128 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:58:37.128 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:37.128 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:37.128 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:37.128 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:37.128 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T00:58:37.128 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T00:58:37.129 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T00:58:37.129 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:37.129 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:58:37.129 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:58:37.129 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T00:58:37.129 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=775dc709-a3a2-42e4-8015-e267c398fc94 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 775dc709-a3a2-42e4-8015-e267c398fc94' 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stdout:add osd2 775dc709-a3a2-42e4-8015-e267c398fc94 2026-02-17T00:58:37.130 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:58:37.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA9vZNp7YZJCBAAzeFzq3Q1Rcc5EYQSTDL6+g== 2026-02-17T00:58:37.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA9vZNp7YZJCBAAzeFzq3Q1Rcc5EYQSTDL6+g=="}' 2026-02-17T00:58:37.139 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 775dc709-a3a2-42e4-8015-e267c398fc94 -i td/osd-bluefs-volume-ops/2/new.json 2026-02-17T00:58:37.368 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T00:58:37.375 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2026-02-17T00:58:37.376 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA9vZNp7YZJCBAAzeFzq3Q1Rcc5EYQSTDL6+g== --osd-uuid 775dc709-a3a2-42e4-8015-e267c398fc94 2026-02-17T00:58:37.390 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:37.390+0000 7f075062c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:37.392 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:37.391+0000 7f075062c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:37.392 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:37.392+0000 7f075062c780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:37.393 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:37.392+0000 7f075062c780 -1 bdev(0x32eec00 td/osd-bluefs-volume-ops/2/block) open stat got: (1) Operation not permitted 2026-02-17T00:58:37.393 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:37.392+0000 7f075062c780 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2026-02-17T00:58:38.098 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2026-02-17T00:58:38.098 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:58:38.098 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-17T00:58:38.099 INFO:tasks.workunit.client.0.trial092.stdout:adding osd2 key to auth repository 2026-02-17T00:58:38.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:58:38.413 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T00:58:38.413 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-17T00:58:38.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:38.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:58:38.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:58:38.414 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:58:38.426 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:38.426+0000 7fb6c140f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:38.428 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:38.427+0000 7fb6c140f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:38.428 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:38.428+0000 7fb6c140f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:38.582 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:38.582+0000 7fb6c140f780 -1 Falling back to public interface 2026-02-17T00:58:38.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-17T00:58:38.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:38.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T00:58:38.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:38.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:38.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:38.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:38.639 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:38.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:38.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:58:38.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:39.152 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:39.151+0000 7fb6c140f780 -1 osd.2 0 log_to_monitors true 2026-02-17T00:58:39.863 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:39.863 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:39.863 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:58:39.863 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:39.863 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:39.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T00:58:40.103 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/1725858793,v1:127.0.0.1:6819/1725858793] [v2:127.0.0.1:6820/1725858793,v1:127.0.0.1:6821/1725858793] exists,up 775dc709-a3a2-42e4-8015-e267c398fc94 2026-02-17T00:58:40.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:40.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:40.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:40.103 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-17T00:58:40.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid2=115031 2026-02-17T00:58:40.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:47: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2026-02-17T00:58:40.105 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T00:58:40.106 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T00:58:40.107 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T00:58:40.107 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T00:58:40.107 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T00:58:40.107 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T00:58:40.107 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T00:58:40.108 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T00:58:40.108 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T00:58:40.108 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=325063f3-470c-458a-a7c8-469fe5fcda28 2026-02-17T00:58:40.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 325063f3-470c-458a-a7c8-469fe5fcda28' 2026-02-17T00:58:40.110 INFO:tasks.workunit.client.0.trial092.stdout:add osd3 325063f3-470c-458a-a7c8-469fe5fcda28 2026-02-17T00:58:40.110 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T00:58:40.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBAvZNpeLIDBxAA8Q0r+1EaF3YvxNUPDKMB7Q== 2026-02-17T00:58:40.117 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBAvZNpeLIDBxAA8Q0r+1EaF3YvxNUPDKMB7Q=="}' 2026-02-17T00:58:40.118 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 325063f3-470c-458a-a7c8-469fe5fcda28 -i td/osd-bluefs-volume-ops/3/new.json 2026-02-17T00:58:40.350 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T00:58:40.357 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2026-02-17T00:58:40.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBAvZNpeLIDBxAA8Q0r+1EaF3YvxNUPDKMB7Q== --osd-uuid 325063f3-470c-458a-a7c8-469fe5fcda28 2026-02-17T00:58:40.373 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:40.373+0000 7f0b0760a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:40.375 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:40.374+0000 7f0b0760a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:40.375 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:40.375+0000 7f0b0760a780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:40.376 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:40.375+0000 7f0b0760a780 -1 bdev(0x37b4c00 td/osd-bluefs-volume-ops/3/block) open stat got: (1) Operation not permitted 2026-02-17T00:58:40.376 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:40.375+0000 7f0b0760a780 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2026-02-17T00:58:41.037 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2026-02-17T00:58:41.037 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T00:58:41.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-17T00:58:41.038 INFO:tasks.workunit.client.0.trial092.stdout:adding osd3 key to auth repository 2026-02-17T00:58:41.039 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T00:58:41.357 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-17T00:58:41.358 INFO:tasks.workunit.client.0.trial092.stdout:start osd.3 2026-02-17T00:58:41.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T00:58:41.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T00:58:41.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T00:58:41.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T00:58:41.372 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:41.372+0000 7f4b5663b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:41.374 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:41.373+0000 7f4b5663b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:41.374 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:41.374+0000 7f4b5663b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T00:58:41.571 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:41.570+0000 7f4b5663b780 -1 Falling back to public interface 2026-02-17T00:58:41.584 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-17T00:58:41.584 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T00:58:41.584 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T00:58:41.584 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T00:58:41.584 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T00:58:41.584 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:41.584 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T00:58:41.584 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T00:58:41.585 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:41.585 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T00:58:41.809 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T00:58:42.136 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T00:58:42.135+0000 7f4b5663b780 -1 osd.3 0 log_to_monitors true 2026-02-17T00:58:42.810 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T00:58:42.810 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T00:58:42.810 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T00:58:42.810 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T00:58:42.810 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T00:58:42.810 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T00:58:43.035 INFO:tasks.workunit.client.0.trial092.stdout:osd.3 up in weight 1 up_from 17 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/1878831598,v1:127.0.0.1:6827/1878831598] [v2:127.0.0.1:6828/1878831598,v1:127.0.0.1:6829/1878831598] exists,up 325063f3-470c-458a-a7c8-469fe5fcda28 2026-02-17T00:58:43.035 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T00:58:43.035 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T00:58:43.035 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T00:58:43.035 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-17T00:58:43.036 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: osd_pid3=117152 2026-02-17T00:58:43.036 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: sleep 5 2026-02-17T00:58:48.037 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:52: TEST_bluestore: create_pool foo 16 2026-02-17T00:58:48.038 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-17T00:58:48.313 INFO:tasks.workunit.client.0.trial092.stderr:pool 'foo' already exists 2026-02-17T00:58:48.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T00:58:49.324 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-17T00:58:49.342 INFO:tasks.workunit.client.0.trial092.stdout:hints = 1 2026-02-17T00:58:49.342 INFO:tasks.workunit.client.0.trial092.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-17T00:58:49.343 INFO:tasks.workunit.client.0.trial092.stdout:Object prefix: benchmark_data_trial092_118085 2026-02-17T00:58:49.343 INFO:tasks.workunit.client.0.trial092.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T00:58:49.343 INFO:tasks.workunit.client.0.trial092.stdout: 0 0 0 0 0 0 - 0 2026-02-17T00:58:50.343 INFO:tasks.workunit.client.0.trial092.stdout: 1 16 11448 11432 44.6426 44.6562 0.0019571 0.00139761 2026-02-17T00:58:51.343 INFO:tasks.workunit.client.0.trial092.stdout: 2 16 23072 23056 45.0226 45.4062 0.00102608 0.00138652 2026-02-17T00:58:52.343 INFO:tasks.workunit.client.0.trial092.stdout: 3 16 34648 34632 45.0868 45.2188 0.000766321 0.00138457 2026-02-17T00:58:53.343 INFO:tasks.workunit.client.0.trial092.stdout: 4 16 46329 46313 45.2214 45.6289 0.00194026 0.00138058 2026-02-17T00:58:54.343 INFO:tasks.workunit.client.0.trial092.stdout: 5 16 58128 58112 45.3944 46.0898 0.0022711 0.00137547 2026-02-17T00:58:55.343 INFO:tasks.workunit.client.0.trial092.stdout: 6 15 69774 69759 45.4107 45.4961 0.00212509 0.00137498 2026-02-17T00:58:56.343 INFO:tasks.workunit.client.0.trial092.stdout: 7 16 81321 81305 45.3661 45.1016 0.00114021 0.00137635 2026-02-17T00:58:57.343 INFO:tasks.workunit.client.0.trial092.stdout: 8 16 92857 92841 45.3277 45.0625 0.00101376 0.00137747 2026-02-17T00:58:58.343 INFO:tasks.workunit.client.0.trial092.stdout: 9 16 104332 104316 45.2714 44.8242 0.00188028 0.00137923 2026-02-17T00:58:59.343 INFO:tasks.workunit.client.0.trial092.stdout: 10 16 115922 115906 45.2713 45.2734 0.00307484 0.00137909 2026-02-17T00:59:00.343 INFO:tasks.workunit.client.0.trial092.stdout: 11 16 127326 127310 45.2051 44.5469 0.000750381 0.00138129 2026-02-17T00:59:01.344 INFO:tasks.workunit.client.0.trial092.stdout: 12 16 138736 138720 45.1519 44.5703 0.00181049 0.00138291 2026-02-17T00:59:02.344 INFO:tasks.workunit.client.0.trial092.stdout: 13 16 149033 149017 44.7725 40.2227 0.00126186 0.00139466 2026-02-17T00:59:03.343 INFO:tasks.workunit.client.0.trial092.stdout: 14 15 159428 159413 44.4749 40.6094 0.00325264 0.00140395 2026-02-17T00:59:04.343 INFO:tasks.workunit.client.0.trial092.stdout: 15 16 169362 169346 44.0964 38.8008 0.00119621 0.00141601 2026-02-17T00:59:05.344 INFO:tasks.workunit.client.0.trial092.stdout: 16 16 177115 177099 43.2331 30.2852 0.184336 0.00143667 2026-02-17T00:59:06.344 INFO:tasks.workunit.client.0.trial092.stdout: 17 16 177197 177181 40.7089 0.320312 0.122403 0.00152039 2026-02-17T00:59:07.344 INFO:tasks.workunit.client.0.trial092.stdout: 18 16 177305 177289 38.4707 0.421875 0.15429 0.00161519 2026-02-17T00:59:08.344 INFO:tasks.workunit.client.0.trial092.stdout: 19 16 177400 177384 36.4655 0.371094 0.142798 0.00170093 2026-02-17T00:59:09.344 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T00:59:09.345123+0000 min lat: 0.000380395 max lat: 0.286827 avg lat: 0.00178251 2026-02-17T00:59:09.344 INFO:tasks.workunit.client.0.trial092.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T00:59:09.344 INFO:tasks.workunit.client.0.trial092.stdout: 20 16 177483 177467 34.6585 0.324219 0.137398 0.00178251 2026-02-17T00:59:10.344 INFO:tasks.workunit.client.0.trial092.stdout: 21 16 185887 185871 34.5712 32.8281 0.0021613 0.00180657 2026-02-17T00:59:11.344 INFO:tasks.workunit.client.0.trial092.stdout: 22 16 195888 195872 34.7754 39.0664 0.00141315 0.00179593 2026-02-17T00:59:12.344 INFO:tasks.workunit.client.0.trial092.stdout: 23 16 206003 205987 34.9812 39.5117 0.00150042 0.00178539 2026-02-17T00:59:13.344 INFO:tasks.workunit.client.0.trial092.stdout: 24 15 216187 216172 35.1812 39.7852 0.00579045 0.00177513 2026-02-17T00:59:14.344 INFO:tasks.workunit.client.0.trial092.stdout: 25 15 226318 226303 35.3568 39.5742 0.00104149 0.00176642 2026-02-17T00:59:15.344 INFO:tasks.workunit.client.0.trial092.stdout: 26 16 231463 231447 34.7697 20.0938 0.176193 0.00179201 2026-02-17T00:59:16.344 INFO:tasks.workunit.client.0.trial092.stdout: 27 16 231567 231551 33.497 0.40625 0.125674 0.00185914 2026-02-17T00:59:17.345 INFO:tasks.workunit.client.0.trial092.stdout: 28 16 234510 234494 32.7112 11.4961 0.00148093 0.00190934 2026-02-17T00:59:18.344 INFO:tasks.workunit.client.0.trial092.stdout: 29 16 244575 244559 32.9389 39.3164 0.00134566 0.00189615 2026-02-17T00:59:19.345 INFO:tasks.workunit.client.0.trial092.stdout:Total time run: 30.0009 2026-02-17T00:59:19.345 INFO:tasks.workunit.client.0.trial092.stdout:Total writes made: 254627 2026-02-17T00:59:19.345 INFO:tasks.workunit.client.0.trial092.stdout:Write size: 4096 2026-02-17T00:59:19.345 INFO:tasks.workunit.client.0.trial092.stdout:Object size: 4096 2026-02-17T00:59:19.345 INFO:tasks.workunit.client.0.trial092.stdout:Bandwidth (MB/sec): 33.1535 2026-02-17T00:59:19.345 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Bandwidth: 16.9958 2026-02-17T00:59:19.346 INFO:tasks.workunit.client.0.trial092.stdout:Max bandwidth (MB/sec): 46.0898 2026-02-17T00:59:19.346 INFO:tasks.workunit.client.0.trial092.stdout:Min bandwidth (MB/sec): 0.320312 2026-02-17T00:59:19.346 INFO:tasks.workunit.client.0.trial092.stdout:Average IOPS: 8487 2026-02-17T00:59:19.346 INFO:tasks.workunit.client.0.trial092.stdout:Stddev IOPS: 4350.93 2026-02-17T00:59:19.346 INFO:tasks.workunit.client.0.trial092.stdout:Max IOPS: 11799 2026-02-17T00:59:19.346 INFO:tasks.workunit.client.0.trial092.stdout:Min IOPS: 82 2026-02-17T00:59:19.346 INFO:tasks.workunit.client.0.trial092.stdout:Average Latency(s): 0.00188392 2026-02-17T00:59:19.346 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Latency(s): 0.00850993 2026-02-17T00:59:19.346 INFO:tasks.workunit.client.0.trial092.stdout:Max latency(s): 0.289147 2026-02-17T00:59:19.346 INFO:tasks.workunit.client.0.trial092.stdout:Min latency(s): 0.000380395 2026-02-17T00:59:19.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:57: TEST_bluestore: echo 'after bench' 2026-02-17T00:59:19.348 INFO:tasks.workunit.client.0.trial092.stdout:after bench 2026-02-17T00:59:19.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 110675 2026-02-17T00:59:19.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-17T00:59:20.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 110675 2026-02-17T00:59:20.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (110675) - No such process 2026-02-17T00:59:20.349 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 0 2026-02-17T00:59:20.579 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already down. 2026-02-17T00:59:20.587 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 112910 2026-02-17T00:59:20.587 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-17T00:59:21.588 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 112910 2026-02-17T00:59:21.588 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (112910) - No such process 2026-02-17T00:59:21.588 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 1 2026-02-17T00:59:21.820 INFO:tasks.workunit.client.0.trial092.stderr:osd.1 is already down. 2026-02-17T00:59:21.828 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 115031 2026-02-17T00:59:21.828 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-17T00:59:22.829 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 115031 2026-02-17T00:59:22.829 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (115031) - No such process 2026-02-17T00:59:22.829 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 2 2026-02-17T00:59:23.054 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already down. 2026-02-17T00:59:23.062 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 117152 2026-02-17T00:59:23.063 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: sleep 1 2026-02-17T00:59:24.063 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 117152 2026-02-17T00:59:24.063 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 66: kill: (117152) - No such process 2026-02-17T00:59:24.064 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:67: TEST_bluestore: ceph osd down 3 2026-02-17T00:59:24.344 INFO:tasks.workunit.client.0.trial092.stderr:osd.3 is already down. 2026-02-17T00:59:24.351 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T00:59:27.208 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T00:59:27.232 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-17T00:59:30.040 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T00:59:30.061 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:72: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-17T00:59:32.909 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T00:59:32.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-17T00:59:35.788 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T00:59:35.809 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-17T00:59:35.810 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-17T00:59:35.820 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T00:59:38.198 INFO:tasks.workunit.client.0.trial092.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-17T00:59:38.198 INFO:tasks.workunit.client.0.trial092.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-17T00:59:38.198 INFO:tasks.workunit.client.0.trial092.stdout:2 : device size 0x100000000(4 GiB) : using 0xaea50000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xaea50000(2.7 GiB) 2026-02-17T00:59:38.198 INFO:tasks.workunit.client.0.trial092.stdout:Expanding DB/WAL... 2026-02-17T00:59:38.199 INFO:tasks.workunit.client.0.trial092.stdout:0 : nothing to do, skipped 2026-02-17T00:59:38.201 INFO:tasks.workunit.client.0.trial092.stdout:1 : nothing to do, skipped 2026-02-17T00:59:38.201 INFO:tasks.workunit.client.0.trial092.stdout:2 : Expanding to 0x100000000(4 GiB) 2026-02-17T00:59:38.310 INFO:tasks.workunit.client.0.trial092.stdout:2 : size updated to 0x100000000(4 GiB) 2026-02-17T00:59:40.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:77: TEST_bluestore: truncate td/osd-bluefs-volume-ops/1/block -s 11811160064 2026-02-17T00:59:40.921 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:78: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 bluefs-bdev-expand 2026-02-17T00:59:40.931 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T00:59:43.272 INFO:tasks.workunit.client.0.trial092.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-17T00:59:43.272 INFO:tasks.workunit.client.0.trial092.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-17T00:59:43.272 INFO:tasks.workunit.client.0.trial092.stdout:2 : device size 0x2c0000000(11 GiB) : using 0x26e97e000(9.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x26e97e000(9.7 GiB) 2026-02-17T00:59:43.272 INFO:tasks.workunit.client.0.trial092.stdout:Expanding DB/WAL... 2026-02-17T00:59:43.272 INFO:tasks.workunit.client.0.trial092.stdout:0 : nothing to do, skipped 2026-02-17T00:59:43.272 INFO:tasks.workunit.client.0.trial092.stdout:1 : nothing to do, skipped 2026-02-17T00:59:43.272 INFO:tasks.workunit.client.0.trial092.stdout:2 : Expanding to 0x2c0000000(11 GiB) 2026-02-17T00:59:43.273 INFO:tasks.workunit.client.0.trial092.stdout:2 : size updated to 0x2c0000000(11 GiB) 2026-02-17T00:59:46.078 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:79: TEST_bluestore: truncate td/osd-bluefs-volume-ops/2/block -s 4295099392 2026-02-17T00:59:46.079 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:80: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 bluefs-bdev-expand 2026-02-17T00:59:46.089 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T00:59:48.443 INFO:tasks.workunit.client.0.trial092.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-17T00:59:48.443 INFO:tasks.workunit.client.0.trial092.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-17T00:59:48.443 INFO:tasks.workunit.client.0.trial092.stdout:2 : device size 0x100020000(4.0 GiB) : using 0xaea06000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xaea06000(2.7 GiB) 2026-02-17T00:59:48.443 INFO:tasks.workunit.client.0.trial092.stdout:Expanding DB/WAL... 2026-02-17T00:59:48.443 INFO:tasks.workunit.client.0.trial092.stdout:0 : nothing to do, skipped 2026-02-17T00:59:48.443 INFO:tasks.workunit.client.0.trial092.stdout:1 : nothing to do, skipped 2026-02-17T00:59:48.443 INFO:tasks.workunit.client.0.trial092.stdout:2 : Expanding to 0x100020000(4.0 GiB) 2026-02-17T00:59:48.444 INFO:tasks.workunit.client.0.trial092.stdout:2 : size updated to 0x100020000(4.0 GiB) 2026-02-17T00:59:51.084 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:81: TEST_bluestore: truncate td/osd-bluefs-volume-ops/3/block -s 4293918720 2026-02-17T00:59:51.085 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:82: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 bluefs-bdev-expand 2026-02-17T00:59:51.095 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T00:59:53.458 INFO:tasks.workunit.client.0.trial092.stdout:0 : device size 0x20000000(512 MiB) : using 0x16d00000(365 MiB) 2026-02-17T00:59:53.459 INFO:tasks.workunit.client.0.trial092.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-17T00:59:53.459 INFO:tasks.workunit.client.0.trial092.stdout:2 : device size 0xfff00000(4.0 GiB) : using 0xaea04000(2.7 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0xaea04000(2.7 GiB) 2026-02-17T00:59:53.459 INFO:tasks.workunit.client.0.trial092.stdout:Expanding DB/WAL... 2026-02-17T00:59:53.459 INFO:tasks.workunit.client.0.trial092.stdout:0 : nothing to do, skipped 2026-02-17T00:59:53.459 INFO:tasks.workunit.client.0.trial092.stdout:1 : nothing to do, skipped 2026-02-17T00:59:53.459 INFO:tasks.workunit.client.0.trial092.stdout:2 : Expanding to 0xfff00000(4.0 GiB) 2026-02-17T00:59:53.460 INFO:tasks.workunit.client.0.trial092.stdout:2 : size updated to 0xfff00000(4.0 GiB) 2026-02-17T00:59:56.063 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:85: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T00:59:56.695 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T00:59:56.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:86: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-17T00:59:57.339 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T00:59:57.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:87: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-17T00:59:58.009 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T00:59:58.030 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:88: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-17T00:59:58.646 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T00:59:58.668 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:90: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-17T00:59:58.677 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T00:59:58.775 INFO:tasks.workunit.client.0.trial092.stdout:0 : device size 0x20000000(512 MiB) : using 0x500000(5 MiB) 2026-02-17T00:59:58.775 INFO:tasks.workunit.client.0.trial092.stdout:1 : device size 0x40000000(1 GiB) : using 0x4000000(64 MiB) 2026-02-17T00:59:58.775 INFO:tasks.workunit.client.0.trial092.stdout:2 : device size 0x100000000(4 GiB) : using 0x2ea50000(746 MiB) : bluefs used 0x0(0 B) : non-bluefs used 0x2ea50000(746 MiB) 2026-02-17T00:59:58.841 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:92: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/block.db --command bluefs-bdev-migrate 2026-02-17T00:59:58.851 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T00:59:59.096 INFO:tasks.workunit.client.0.trial092.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-17T00:59:59.098 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:97: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T00:59:59.687 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T00:59:59.709 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:100: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-17T00:59:59.718 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:00:00.015 INFO:tasks.workunit.client.0.trial092.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-17T01:00:00.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:105: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-17T01:00:00.634 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:00:00.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:108: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block.wal --devs-source td/osd-bluefs-volume-ops/2/block.db --dev-target td/osd-bluefs-volume-ops/2/block --command bluefs-bdev-migrate 2026-02-17T01:00:00.665 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:00:00.991 INFO:tasks.workunit.client.0.trial092.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-17T01:00:00.991 INFO:tasks.workunit.client.0.trial092.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-17T01:00:00.994 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:114: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-17T01:00:01.549 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:00:01.570 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:117: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block.wal --command bluefs-bdev-migrate 2026-02-17T01:00:01.580 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:00:01.630 INFO:tasks.workunit.client.0.trial092.stderr:Migrate to WAL device isn't supported. 2026-02-17T01:00:01.632 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:123: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-17T01:00:01.632 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:126: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-17T01:00:02.249 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:00:02.271 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:129: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-17T01:00:02.280 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:00:02.546 INFO:tasks.workunit.client.0.trial092.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-17T01:00:02.548 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:134: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-17T01:00:03.135 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:00:03.156 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:136: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --dev-target td/osd-bluefs-volume-ops/3/block.db --command bluefs-bdev-migrate 2026-02-17T01:00:03.165 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:00:03.334 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:141: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-17T01:00:03.907 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:00:03.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:143: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-17T01:00:03.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:00:03.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:00:03.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T01:00:03.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:00:03.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-17T01:00:03.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:00:03.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:00:03.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:00:03.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:00:03.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-17T01:00:03.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-17T01:00:03.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:00:03.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:00:03.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:00:03.938 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:00:03.938 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:00:03.938 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:00:03.938 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:00:03.938 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:00:03.938 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-17T01:00:03.938 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T01:00:03.938 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T01:00:03.939 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:00:03.939 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-17T01:00:03.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T01:00:03.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:00:03.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:00:03.940 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:00:03.948 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:03.948+0000 7f9a8a9d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:03.950 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:03.950+0000 7f9a8a9d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:03.951 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:03.951+0000 7f9a8a9d8780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:04.105 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:04.104+0000 7f9a8a9d8780 -1 Falling back to public interface 2026-02-17T01:00:04.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T01:00:04.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:00:04.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T01:00:04.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:00:04.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:00:04.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:04.168 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:00:04.169 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:00:04.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:04.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:00:04.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:00:05.319 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:05.319+0000 7f9a8a9d8780 -1 osd.0 20 log_to_monitors true 2026-02-17T01:00:05.394 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:00:05.395 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:05.395 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:00:05.395 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:00:05.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:05.396 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:00:05.627 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:00:06.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:00:06.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:06.629 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:00:06.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:00:06.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:06.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:00:06.852 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 29 up_thru 29 down_at 21 last_clean_interval [5,20) [v2:127.0.0.1:6800/4250255043,v1:127.0.0.1:6801/4250255043] [v2:127.0.0.1:6802/4250255043,v1:127.0.0.1:6803/4250255043] exists,up acd97186-aaca-45b8-ae31-942f7123432f 2026-02-17T01:00:06.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:00:06.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:00:06.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:00:06.854 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-17T01:00:06.858 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: osd_pid0=128750 2026-02-17T01:00:06.858 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:145: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-17T01:00:06.858 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:00:06.858 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:00:06.858 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T01:00:06.858 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:00:06.858 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-17T01:00:06.858 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:00:06.858 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:00:06.859 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:00:06.859 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:00:06.859 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-17T01:00:06.859 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-17T01:00:06.859 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:00:06.859 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:00:06.859 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:00:06.859 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:00:06.859 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:00:06.859 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:00:06.859 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:00:06.860 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:00:06.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:00:06.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-17T01:00:06.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T01:00:06.861 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T01:00:06.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:00:06.862 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-17T01:00:06.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T01:00:06.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:00:06.863 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:00:06.863 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:00:06.870 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:06.869+0000 7f3756e40780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:06.871 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:06.871+0000 7f3756e40780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:06.872 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:06.872+0000 7f3756e40780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:07.027 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:07.026+0000 7f3756e40780 -1 Falling back to public interface 2026-02-17T01:00:07.083 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T01:00:07.084 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:00:07.084 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T01:00:07.084 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:00:07.084 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:00:07.084 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:07.084 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:00:07.084 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:00:07.085 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:07.085 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:00:07.310 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:00:08.252 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:08.252+0000 7f3756e40780 -1 osd.1 22 log_to_monitors true 2026-02-17T01:00:08.311 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:00:08.312 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:08.312 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:00:08.312 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:00:08.313 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:08.313 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:00:08.542 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:00:09.543 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:00:09.543 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:09.544 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:00:09.544 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:00:09.544 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:09.545 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:00:09.769 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 33 up_thru 33 down_at 23 last_clean_interval [9,22) [v2:127.0.0.1:6810/965194937,v1:127.0.0.1:6811/965194937] [v2:127.0.0.1:6812/965194937,v1:127.0.0.1:6813/965194937] exists,up 4081cf48-22d6-40a5-8af4-1d30e1c6dfab 2026-02-17T01:00:09.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:00:09.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:00:09.770 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:00:09.770 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: osd_pid1=129690 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:147: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-17T01:00:09.771 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-17T01:00:09.772 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:00:09.772 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:00:09.772 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:00:09.772 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:00:09.772 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:00:09.772 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:00:09.772 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:00:09.772 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:00:09.772 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:00:09.772 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:00:09.772 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T01:00:09.773 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:00:09.774 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-17T01:00:09.775 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T01:00:09.776 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:00:09.776 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:00:09.776 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:00:09.787 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:09.787+0000 7f1ec6e33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:09.788 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:09.788+0000 7f1ec6e33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:09.789 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:09.789+0000 7f1ec6e33780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:09.925 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:09.925+0000 7f1ec6e33780 -1 Falling back to public interface 2026-02-17T01:00:10.007 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T01:00:10.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:00:10.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T01:00:10.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:00:10.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:00:10.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:10.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:00:10.008 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:00:10.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:10.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:00:10.236 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:00:11.080 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:11.079+0000 7f1ec6e33780 -1 osd.2 24 log_to_monitors true 2026-02-17T01:00:11.238 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:00:11.238 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:11.238 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:00:11.239 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:00:11.239 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:11.239 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:00:11.468 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:00:12.469 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:00:12.469 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:12.469 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:00:12.470 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:00:12.470 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:12.470 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:00:12.695 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 37 up_thru 37 down_at 25 last_clean_interval [13,24) [v2:127.0.0.1:6818/3145213318,v1:127.0.0.1:6819/3145213318] [v2:127.0.0.1:6820/3145213318,v1:127.0.0.1:6821/3145213318] exists,up 775dc709-a3a2-42e4-8015-e267c398fc94 2026-02-17T01:00:12.696 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:00:12.696 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:00:12.696 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:00:12.696 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-17T01:00:12.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: osd_pid2=130630 2026-02-17T01:00:12.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:149: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-17T01:00:12.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:00:12.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:00:12.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T01:00:12.700 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:00:12.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-17T01:00:12.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:00:12.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:00:12.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:00:12.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:00:12.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-17T01:00:12.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-17T01:00:12.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:00:12.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:00:12.702 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:00:12.702 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:00:12.702 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:00:12.702 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:00:12.702 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:00:12.702 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:00:12.702 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:00:12.702 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:00:12.702 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:00:12.702 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:00:12.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:00:12.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:00:12.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:00:12.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:00:12.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:00:12.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:00:12.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:00:12.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:00:12.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-17T01:00:12.704 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T01:00:12.704 INFO:tasks.workunit.client.0.trial092.stdout:start osd.3 2026-02-17T01:00:12.705 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:00:12.705 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-17T01:00:12.705 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T01:00:12.705 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:00:12.705 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:00:12.706 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:00:12.714 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:12.714+0000 7fb30a631780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:12.715 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:12.715+0000 7fb30a631780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:12.716 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:12.716+0000 7fb30a631780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:00:12.913 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:12.913+0000 7fb30a631780 -1 Falling back to public interface 2026-02-17T01:00:12.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T01:00:12.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:00:12.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T01:00:12.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:00:12.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:00:12.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:12.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:00:12.925 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:00:12.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:12.925 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:00:13.148 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:00:14.149 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:00:14.149 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:14.149 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:00:14.149 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:00:14.149 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:14.149 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:00:14.165 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:00:14.165+0000 7fb30a631780 -1 osd.3 26 log_to_monitors true 2026-02-17T01:00:14.378 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:00:15.380 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:00:15.380 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:00:15.380 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:00:15.381 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:00:15.381 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:00:15.381 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:00:15.611 INFO:tasks.workunit.client.0.trial092.stdout:osd.3 up in weight 1 up_from 42 up_thru 42 down_at 27 last_clean_interval [17,26) [v2:127.0.0.1:6826/2826274233,v1:127.0.0.1:6827/2826274233] [v2:127.0.0.1:6828/2826274233,v1:127.0.0.1:6829/2826274233] exists,up 325063f3-470c-458a-a7c8-469fe5fcda28 2026-02-17T01:00:15.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:00:15.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:00:15.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:00:15.613 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-17T01:00:15.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: osd_pid3=131885 2026-02-17T01:00:15.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:152: TEST_bluestore: wait_for_clean 2026-02-17T01:00:15.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T01:00:15.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T01:00:15.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T01:00:15.614 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T01:00:15.614 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T01:00:15.614 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T01:00:15.614 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T01:00:15.614 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T01:00:15.614 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T01:00:15.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T01:00:15.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T01:00:15.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T01:00:15.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T01:00:15.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T01:00:15.697 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T01:00:15.919 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T01:00:15.919 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T01:00:15.919 INFO:tasks.workunit.client.0.trial092.stderr:2 2026-02-17T01:00:15.920 INFO:tasks.workunit.client.0.trial092.stderr:3' 2026-02-17T01:00:15.920 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T01:00:15.920 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T01:00:15.920 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T01:00:15.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=124554051589 2026-02-17T01:00:15.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 124554051589 2026-02-17T01:00:15.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051589' 2026-02-17T01:00:15.988 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T01:00:15.988 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T01:00:16.050 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920772 2026-02-17T01:00:16.051 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920772 2026-02-17T01:00:16.051 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051589 1-141733920772' 2026-02-17T01:00:16.051 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T01:00:16.051 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T01:00:16.113 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789955 2026-02-17T01:00:16.114 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789955 2026-02-17T01:00:16.114 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051589 1-141733920772 2-158913789955' 2026-02-17T01:00:16.114 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T01:00:16.114 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T01:00:16.177 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=180388626435 2026-02-17T01:00:16.177 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 180388626435 2026-02-17T01:00:16.177 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-124554051589 1-141733920772 2-158913789955 3-180388626435' 2026-02-17T01:00:16.177 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T01:00:16.177 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-124554051589 2026-02-17T01:00:16.177 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T01:00:16.178 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T01:00:16.179 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-124554051589 2026-02-17T01:00:16.179 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T01:00:16.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=124554051589 2026-02-17T01:00:16.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 124554051589' 2026-02-17T01:00:16.180 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 124554051589 2026-02-17T01:00:16.181 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T01:00:16.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051586 -lt 124554051589 2026-02-17T01:00:16.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T01:00:17.411 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T01:00:17.412 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T01:00:17.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 124554051589 -lt 124554051589 2026-02-17T01:00:17.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T01:00:17.638 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-141733920772 2026-02-17T01:00:17.638 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T01:00:17.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T01:00:17.639 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-141733920772 2026-02-17T01:00:17.639 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T01:00:17.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=141733920772 2026-02-17T01:00:17.641 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 141733920772 2026-02-17T01:00:17.641 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 141733920772' 2026-02-17T01:00:17.641 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T01:00:17.865 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 141733920772 -lt 141733920772 2026-02-17T01:00:17.865 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T01:00:17.866 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-158913789955 2026-02-17T01:00:17.866 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T01:00:17.867 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T01:00:17.867 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789955 2026-02-17T01:00:17.867 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T01:00:17.869 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=158913789955 2026-02-17T01:00:17.869 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 158913789955' 2026-02-17T01:00:17.869 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 158913789955 2026-02-17T01:00:17.869 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T01:00:18.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 158913789956 -lt 158913789955 2026-02-17T01:00:18.093 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T01:00:18.094 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-180388626435 2026-02-17T01:00:18.094 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T01:00:18.095 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T01:00:18.095 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-180388626435 2026-02-17T01:00:18.096 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T01:00:18.097 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=180388626435 2026-02-17T01:00:18.097 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 180388626435' 2026-02-17T01:00:18.097 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.3 seq 180388626435 2026-02-17T01:00:18.097 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T01:00:18.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 180388626435 -lt 180388626435 2026-02-17T01:00:18.320 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T01:00:18.321 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T01:00:18.321 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T01:00:18.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-17T01:00:18.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T01:00:18.639 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T01:00:18.639 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T01:00:18.640 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T01:00:18.640 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T01:00:18.640 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T01:00:18.640 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T01:00:18.861 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-17T01:00:18.862 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T01:00:18.863 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T01:00:18.863 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T01:00:19.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-17T01:00:19.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T01:00:19.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T01:00:19.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:155: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-17T01:00:19.196 INFO:tasks.workunit.client.0.trial092.stdout:hints = 1 2026-02-17T01:00:19.196 INFO:tasks.workunit.client.0.trial092.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-17T01:00:19.196 INFO:tasks.workunit.client.0.trial092.stdout:Object prefix: benchmark_data_trial092_133211 2026-02-17T01:00:19.196 INFO:tasks.workunit.client.0.trial092.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T01:00:19.196 INFO:tasks.workunit.client.0.trial092.stdout: 0 0 0 0 0 0 - 0 2026-02-17T01:00:20.195 INFO:tasks.workunit.client.0.trial092.stdout: 1 16 12143 12127 47.3667 47.3711 0.00102803 0.0013167 2026-02-17T01:00:21.196 INFO:tasks.workunit.client.0.trial092.stdout: 2 16 24081 24065 46.9978 46.6328 0.000910909 0.00132818 2026-02-17T01:00:22.196 INFO:tasks.workunit.client.0.trial092.stdout: 3 16 36165 36149 47.0651 47.2031 0.000752455 0.00132577 2026-02-17T01:00:23.196 INFO:tasks.workunit.client.0.trial092.stdout: 4 16 48331 48315 47.1788 47.5234 0.00141151 0.00132313 2026-02-17T01:00:24.196 INFO:tasks.workunit.client.0.trial092.stdout: 5 16 60288 60272 47.0841 46.707 0.00108973 0.00132596 2026-02-17T01:00:25.196 INFO:tasks.workunit.client.0.trial092.stdout: 6 16 72252 72236 47.0252 46.7344 0.000893648 0.00132767 2026-02-17T01:00:26.196 INFO:tasks.workunit.client.0.trial092.stdout: 7 16 83812 83796 46.7577 45.1562 0.00116165 0.00133527 2026-02-17T01:00:27.196 INFO:tasks.workunit.client.0.trial092.stdout: 8 16 95149 95133 46.4482 44.2852 0.000788893 0.0013442 2026-02-17T01:00:28.196 INFO:tasks.workunit.client.0.trial092.stdout: 9 16 106391 106375 46.1662 43.9141 0.000981781 0.00135244 2026-02-17T01:00:29.196 INFO:tasks.workunit.client.0.trial092.stdout: 10 16 117278 117262 45.802 42.5273 0.00136895 0.00136321 2026-02-17T01:00:30.196 INFO:tasks.workunit.client.0.trial092.stdout: 11 15 128088 128073 45.477 42.2305 0.0014919 0.00137299 2026-02-17T01:00:31.196 INFO:tasks.workunit.client.0.trial092.stdout: 12 15 138937 138922 45.2186 42.3789 0.00106888 0.00138082 2026-02-17T01:00:32.196 INFO:tasks.workunit.client.0.trial092.stdout: 13 16 149218 149202 44.8289 40.1562 0.001212 0.00139286 2026-02-17T01:00:33.196 INFO:tasks.workunit.client.0.trial092.stdout: 14 16 159613 159597 44.527 40.6055 0.00128545 0.00140231 2026-02-17T01:00:34.196 INFO:tasks.workunit.client.0.trial092.stdout: 15 15 169850 169835 44.2245 39.9922 0.00136349 0.00141192 2026-02-17T01:00:35.196 INFO:tasks.workunit.client.0.trial092.stdout: 16 16 180123 180107 43.968 40.125 0.00153291 0.00142018 2026-02-17T01:00:36.197 INFO:tasks.workunit.client.0.trial092.stdout: 17 16 190595 190579 43.7878 40.9062 0.000862389 0.00142601 2026-02-17T01:00:37.197 INFO:tasks.workunit.client.0.trial092.stdout: 18 16 196621 196605 42.6627 23.5391 0.102541 0.00146052 2026-02-17T01:00:38.197 INFO:tasks.workunit.client.0.trial092.stdout: 19 16 196799 196783 40.4539 0.695312 0.0660963 0.00154147 2026-02-17T01:00:39.197 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T01:00:39.198633+0000 min lat: 0.000405352 max lat: 0.221812 avg lat: 0.00161965 2026-02-17T01:00:39.197 INFO:tasks.workunit.client.0.trial092.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T01:00:39.197 INFO:tasks.workunit.client.0.trial092.stdout: 20 16 196898 196882 38.4506 0.386719 0.123736 0.00161965 2026-02-17T01:00:40.197 INFO:tasks.workunit.client.0.trial092.stdout: 21 16 196995 196979 36.6377 0.378906 0.155185 0.00169568 2026-02-17T01:00:41.197 INFO:tasks.workunit.client.0.trial092.stdout: 22 16 197108 197092 34.9924 0.441406 0.13698 0.00177731 2026-02-17T01:00:42.197 INFO:tasks.workunit.client.0.trial092.stdout: 23 16 204613 204597 34.7455 29.3164 0.00165319 0.00179747 2026-02-17T01:00:43.197 INFO:tasks.workunit.client.0.trial092.stdout: 24 16 214868 214852 34.9668 40.0586 0.00111306 0.00178611 2026-02-17T01:00:44.197 INFO:tasks.workunit.client.0.trial092.stdout: 25 16 225336 225320 35.2036 40.8906 0.00137078 0.00177408 2026-02-17T01:00:45.197 INFO:tasks.workunit.client.0.trial092.stdout: 26 15 235739 235724 35.4126 40.6406 0.0012847 0.00176362 2026-02-17T01:00:46.197 INFO:tasks.workunit.client.0.trial092.stdout: 27 15 246099 246084 35.5997 40.4688 0.00135252 0.00175433 2026-02-17T01:00:47.198 INFO:tasks.workunit.client.0.trial092.stdout: 28 16 249221 249205 34.7637 12.1914 0.222659 0.00179311 2026-02-17T01:00:48.198 INFO:tasks.workunit.client.0.trial092.stdout: 29 16 249304 249288 33.5761 0.324219 0.209858 0.00185385 2026-02-17T01:00:49.198 INFO:tasks.workunit.client.0.trial092.stdout:Total time run: 30.001 2026-02-17T01:00:49.198 INFO:tasks.workunit.client.0.trial092.stdout:Total writes made: 252805 2026-02-17T01:00:49.198 INFO:tasks.workunit.client.0.trial092.stdout:Write size: 4096 2026-02-17T01:00:49.198 INFO:tasks.workunit.client.0.trial092.stdout:Object size: 4096 2026-02-17T01:00:49.198 INFO:tasks.workunit.client.0.trial092.stdout:Bandwidth (MB/sec): 32.9162 2026-02-17T01:00:49.198 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Bandwidth: 17.0741 2026-02-17T01:00:49.198 INFO:tasks.workunit.client.0.trial092.stdout:Max bandwidth (MB/sec): 47.5234 2026-02-17T01:00:49.199 INFO:tasks.workunit.client.0.trial092.stdout:Min bandwidth (MB/sec): 0.324219 2026-02-17T01:00:49.199 INFO:tasks.workunit.client.0.trial092.stdout:Average IOPS: 8426 2026-02-17T01:00:49.199 INFO:tasks.workunit.client.0.trial092.stdout:Stddev IOPS: 4370.97 2026-02-17T01:00:49.199 INFO:tasks.workunit.client.0.trial092.stdout:Max IOPS: 12166 2026-02-17T01:00:49.199 INFO:tasks.workunit.client.0.trial092.stdout:Min IOPS: 83 2026-02-17T01:00:49.199 INFO:tasks.workunit.client.0.trial092.stdout:Average Latency(s): 0.00189748 2026-02-17T01:00:49.199 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Latency(s): 0.00824349 2026-02-17T01:00:49.199 INFO:tasks.workunit.client.0.trial092.stdout:Max latency(s): 0.314952 2026-02-17T01:00:49.199 INFO:tasks.workunit.client.0.trial092.stdout:Min latency(s): 0.000405352 2026-02-17T01:00:49.200 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 128750 2026-02-17T01:00:49.200 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: sleep 1 2026-02-17T01:00:50.201 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 128750 2026-02-17T01:00:50.201 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 158: kill: (128750) - No such process 2026-02-17T01:00:50.201 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:159: TEST_bluestore: ceph osd down 0 2026-02-17T01:00:50.437 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already down. 2026-02-17T01:00:50.444 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 129690 2026-02-17T01:00:50.444 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: sleep 1 2026-02-17T01:00:51.445 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 129690 2026-02-17T01:00:51.446 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 160: kill: (129690) - No such process 2026-02-17T01:00:51.446 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:161: TEST_bluestore: ceph osd down 1 2026-02-17T01:00:51.672 INFO:tasks.workunit.client.0.trial092.stderr:osd.1 is already down. 2026-02-17T01:00:51.679 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 130630 2026-02-17T01:00:51.679 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: sleep 1 2026-02-17T01:00:52.680 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 130630 2026-02-17T01:00:52.681 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 162: kill: (130630) - No such process 2026-02-17T01:00:52.681 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:163: TEST_bluestore: ceph osd down 2 2026-02-17T01:00:52.913 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already down. 2026-02-17T01:00:52.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 131885 2026-02-17T01:00:52.922 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: sleep 1 2026-02-17T01:00:53.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 131885 2026-02-17T01:00:53.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 164: kill: (131885) - No such process 2026-02-17T01:00:53.924 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:165: TEST_bluestore: ceph osd down 3 2026-02-17T01:00:54.199 INFO:tasks.workunit.client.0.trial092.stderr:osd.3 is already down. 2026-02-17T01:00:54.206 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:168: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T01:00:57.201 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:00:57.234 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:170: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal count=512 bs=1M 2026-02-17T01:00:57.445 INFO:tasks.workunit.client.0.trial092.stderr:512+0 records in 2026-02-17T01:00:57.445 INFO:tasks.workunit.client.0.trial092.stderr:512+0 records out 2026-02-17T01:00:57.445 INFO:tasks.workunit.client.0.trial092.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.208982 s, 2.6 GB/s 2026-02-17T01:00:57.445 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:171: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --dev-target td/osd-bluefs-volume-ops/0/wal --command bluefs-bdev-new-wal 2026-02-17T01:00:57.454 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:01:00.152 INFO:tasks.workunit.client.0.trial092.stdout:WAL device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal 2026-02-17T01:01:00.166 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:175: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T01:01:03.219 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:01:03.255 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:178: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-17T01:01:06.523 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:01:06.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:180: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db count=1024 bs=1M 2026-02-17T01:01:06.978 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records in 2026-02-17T01:01:06.978 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records out 2026-02-17T01:01:06.978 INFO:tasks.workunit.client.0.trial092.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.418766 s, 2.6 GB/s 2026-02-17T01:01:06.978 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:181: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --dev-target td/osd-bluefs-volume-ops/1/db --command bluefs-bdev-new-db 2026-02-17T01:01:06.988 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:01:10.561 INFO:tasks.workunit.client.0.trial092.stdout:DB device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db 2026-02-17T01:01:10.575 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:185: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block --dev-target td/osd-bluefs-volume-ops/1/block.db --command bluefs-bdev-migrate 2026-02-17T01:01:10.585 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:01:13.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:190: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-17T01:01:16.460 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:01:16.497 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:193: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-17T01:01:19.539 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:01:19.571 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:195: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-db 2026-02-17T01:01:19.580 INFO:tasks.workunit.client.0.trial092.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-17T01:01:19.580 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:01:21.927 INFO:tasks.workunit.client.0.trial092.stdout:DB device added 2026-02-17T01:01:21.941 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:198: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-wal 2026-02-17T01:01:21.951 INFO:tasks.workunit.client.0.trial092.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-17T01:01:21.951 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:01:24.328 INFO:tasks.workunit.client.0.trial092.stdout:WAL device added 2026-02-17T01:01:24.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:201: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/block.db --command bluefs-bdev-migrate 2026-02-17T01:01:24.357 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:01:27.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:206: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-17T01:01:30.487 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:01:30.523 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:209: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-17T01:01:33.519 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:01:33.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:211: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --command bluefs-bdev-new-wal 2026-02-17T01:01:33.569 INFO:tasks.workunit.client.0.trial092.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-17T01:01:33.570 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:01:35.881 INFO:tasks.workunit.client.0.trial092.stdout:WAL device added 2026-02-17T01:01:35.896 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:214: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-17T01:01:35.907 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:01:38.820 INFO:tasks.workunit.client.0.trial092.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block.db 2026-02-17T01:01:38.842 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:219: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-17T01:01:41.812 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:01:41.850 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:221: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-17T01:01:41.850 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:01:41.850 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:01:41.850 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T01:01:41.850 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:01:41.850 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-17T01:01:41.850 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:01:41.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:01:41.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:01:41.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:01:41.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-17T01:01:41.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-17T01:01:41.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:01:41.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:01:41.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:01:41.851 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:01:41.851 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:01:41.851 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:01:41.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:01:41.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:01:41.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:01:41.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-17T01:01:41.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T01:01:41.853 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T01:01:41.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:01:41.854 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-17T01:01:41.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T01:01:41.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:01:41.855 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:01:41.855 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:01:41.863 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:41.863+0000 7f617ca0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:01:41.864 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:41.864+0000 7f617ca0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:01:41.865 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:41.865+0000 7f617ca0f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:01:42.045 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:42.045+0000 7f617ca0f780 -1 Falling back to public interface 2026-02-17T01:01:42.074 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T01:01:42.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:01:42.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T01:01:42.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:01:42.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:01:42.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:42.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:01:42.075 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:01:42.076 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:42.076 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:01:42.300 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:43.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:43.302 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:43.303 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:01:43.304 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:01:43.304 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:43.304 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:01:43.536 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:44.537 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:44.537 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:44.537 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:01:44.537 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:01:44.537 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:44.538 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:01:44.775 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:45.776 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:45.776 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:45.776 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-17T01:01:45.776 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T01:01:45.777 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:45.777 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:01:46.008 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:47.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:47.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:47.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-17T01:01:47.010 INFO:tasks.workunit.client.0.trial092.stdout:4 2026-02-17T01:01:47.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:47.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:01:47.241 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:48.123 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:48.123+0000 7f617ca0f780 -1 osd.0 45 log_to_monitors true 2026-02-17T01:01:48.242 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:48.242 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:48.242 INFO:tasks.workunit.client.0.trial092.stdout:5 2026-02-17T01:01:48.243 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-17T01:01:48.243 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:48.243 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:01:48.479 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:49.480 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:49.481 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:49.481 INFO:tasks.workunit.client.0.trial092.stdout:6 2026-02-17T01:01:49.482 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-17T01:01:49.482 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:49.482 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:01:49.715 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 53 up_thru 53 down_at 45 last_clean_interval [29,45) [v2:127.0.0.1:6800/1665776467,v1:127.0.0.1:6801/1665776467] [v2:127.0.0.1:6802/1665776467,v1:127.0.0.1:6803/1665776467] exists,up acd97186-aaca-45b8-ae31-942f7123432f 2026-02-17T01:01:49.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:01:49.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:01:49.716 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:01:49.716 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-17T01:01:49.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: osd_pid0=139381 2026-02-17T01:01:49.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:223: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-17T01:01:49.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:01:49.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:01:49.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T01:01:49.720 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:01:49.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-17T01:01:49.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:01:49.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:01:49.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:01:49.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:01:49.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-17T01:01:49.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-17T01:01:49.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:01:49.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:01:49.721 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:01:49.721 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:01:49.722 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:01:49.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:01:49.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:01:49.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:01:49.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:01:49.723 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-17T01:01:49.723 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T01:01:49.724 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T01:01:49.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:01:49.725 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-17T01:01:49.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T01:01:49.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:01:49.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:01:49.725 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:01:49.733 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:49.734+0000 7f1cf700b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:01:49.735 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:49.735+0000 7f1cf700b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:01:49.736 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:49.736+0000 7f1cf700b780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:01:49.944 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T01:01:49.944 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:01:49.944 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T01:01:49.944 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:01:49.944 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:01:49.944 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:49.944 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:01:49.945 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:01:49.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:49.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:01:49.998 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:50.000+0000 7f1cf700b780 -1 Falling back to public interface 2026-02-17T01:01:50.171 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:51.172 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:51.172 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:51.172 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:01:51.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:01:51.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:51.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:01:51.400 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:52.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:52.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:52.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:01:52.401 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:01:52.402 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:52.402 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:01:52.630 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:53.632 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:53.632 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:53.632 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T01:01:53.633 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-17T01:01:53.633 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:53.633 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:01:53.862 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:54.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:54.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:54.864 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-17T01:01:54.865 INFO:tasks.workunit.client.0.trial092.stdout:4 2026-02-17T01:01:54.865 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:54.865 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:01:55.090 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:56.091 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:56.091 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:56.092 INFO:tasks.workunit.client.0.trial092.stdout:5 2026-02-17T01:01:56.092 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-17T01:01:56.092 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:56.092 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:01:56.324 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:56.445 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:56.446+0000 7f1cf700b780 -1 osd.1 46 log_to_monitors true 2026-02-17T01:01:57.325 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:57.325 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:57.326 INFO:tasks.workunit.client.0.trial092.stdout:6 2026-02-17T01:01:57.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-17T01:01:57.327 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:57.327 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:01:57.553 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 56 up_thru 56 down_at 47 last_clean_interval [33,46) [v2:127.0.0.1:6810/4209137586,v1:127.0.0.1:6811/4209137586] [v2:127.0.0.1:6812/4209137586,v1:127.0.0.1:6813/4209137586] exists,up 4081cf48-22d6-40a5-8af4-1d30e1c6dfab 2026-02-17T01:01:57.553 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:01:57.554 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:01:57.554 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:01:57.554 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-17T01:01:57.557 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: osd_pid1=140583 2026-02-17T01:01:57.557 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:225: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-17T01:01:57.557 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:01:57.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:01:57.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T01:01:57.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:01:57.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-17T01:01:57.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:01:57.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:01:57.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:01:57.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:01:57.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-17T01:01:57.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-17T01:01:57.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:01:57.559 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:01:57.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:01:57.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:01:57.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:01:57.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:01:57.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:01:57.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:01:57.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:01:57.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-17T01:01:57.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T01:01:57.561 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T01:01:57.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:01:57.562 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-17T01:01:57.562 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T01:01:57.562 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:01:57.562 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:01:57.562 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:01:57.570 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:57.572+0000 7f417ee65780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:01:57.572 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:57.573+0000 7f417ee65780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:01:57.573 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:57.574+0000 7f417ee65780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:01:57.738 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:01:57.739+0000 7f417ee65780 -1 Falling back to public interface 2026-02-17T01:01:57.784 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T01:01:57.784 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:01:57.784 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T01:01:57.785 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:01:57.785 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:01:57.785 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:57.785 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:01:57.785 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:01:57.786 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:57.786 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:01:58.009 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:01:59.010 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:01:59.011 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:01:59.011 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:01:59.012 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:01:59.012 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:01:59.012 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:01:59.250 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:02:00.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:02:00.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:02:00.252 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:02:00.252 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:02:00.252 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:02:00.252 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:02:00.483 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:02:01.485 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:02:01.485 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:02:01.485 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T01:02:01.486 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-17T01:02:01.486 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:02:01.486 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:02:01.713 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:02:02.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:02:02.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:02:02.715 INFO:tasks.workunit.client.0.trial092.stdout:4 2026-02-17T01:02:02.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-17T01:02:02.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:02:02.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:02:02.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:02:03.920 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:02:03.922+0000 7f417ee65780 -1 osd.2 49 log_to_monitors true 2026-02-17T01:02:03.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:02:03.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:02:03.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-17T01:02:03.951 INFO:tasks.workunit.client.0.trial092.stdout:5 2026-02-17T01:02:03.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:02:03.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:02:04.176 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 59 up_thru 47 down_at 49 last_clean_interval [37,49) [v2:127.0.0.1:6818/3019649748,v1:127.0.0.1:6819/3019649748] [v2:127.0.0.1:6820/3019649748,v1:127.0.0.1:6821/3019649748] exists,up 775dc709-a3a2-42e4-8015-e267c398fc94 2026-02-17T01:02:04.177 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:02:04.177 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:02:04.177 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:02:04.177 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: osd_pid2=141629 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:227: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:02:04.179 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:02:04.180 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:02:04.180 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:02:04.180 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:02:04.180 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:02:04.180 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stdout:start osd.3 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:02:04.181 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-17T01:02:04.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T01:02:04.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:02:04.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:02:04.182 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:02:04.195 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:02:04.197+0000 7f3900434780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:02:04.197 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:02:04.198+0000 7f3900434780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:02:04.197 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:02:04.199+0000 7f3900434780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:02:04.363 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:02:04.365+0000 7f3900434780 -1 Falling back to public interface 2026-02-17T01:02:04.409 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T01:02:04.409 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:02:04.409 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T01:02:04.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:02:04.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:02:04.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:02:04.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:02:04.410 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:02:04.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:02:04.410 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:02:04.636 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:02:05.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:02:05.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:02:05.639 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:02:05.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:02:05.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:02:05.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:02:05.866 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:02:06.867 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:02:06.867 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:02:06.867 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:02:06.868 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:02:06.868 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:02:06.868 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:02:07.098 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:02:08.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:02:08.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:02:08.099 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T01:02:08.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-17T01:02:08.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:02:08.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:02:08.325 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:02:09.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:02:09.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:02:09.326 INFO:tasks.workunit.client.0.trial092.stdout:4 2026-02-17T01:02:09.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-17T01:02:09.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:02:09.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:02:09.557 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:02:10.320 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:02:10.320+0000 7f3900434780 -1 osd.3 50 log_to_monitors true 2026-02-17T01:02:10.557 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:02:10.557 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:02:10.558 INFO:tasks.workunit.client.0.trial092.stdout:5 2026-02-17T01:02:10.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-17T01:02:10.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:02:10.558 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:02:10.783 INFO:tasks.workunit.client.0.trial092.stdout:osd.3 up in weight 1 up_from 63 up_thru 63 down_at 51 last_clean_interval [42,50) [v2:127.0.0.1:6826/348481797,v1:127.0.0.1:6827/348481797] [v2:127.0.0.1:6828/348481797,v1:127.0.0.1:6829/348481797] exists,up 325063f3-470c-458a-a7c8-469fe5fcda28 2026-02-17T01:02:10.783 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:02:10.784 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:02:10.784 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:02:10.784 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-17T01:02:10.784 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: osd_pid3=142649 2026-02-17T01:02:10.785 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:231: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-17T01:02:10.801 INFO:tasks.workunit.client.0.trial092.stdout:hints = 1 2026-02-17T01:02:10.801 INFO:tasks.workunit.client.0.trial092.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-17T01:02:10.801 INFO:tasks.workunit.client.0.trial092.stdout:Object prefix: benchmark_data_trial092_143649 2026-02-17T01:02:10.801 INFO:tasks.workunit.client.0.trial092.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T01:02:10.802 INFO:tasks.workunit.client.0.trial092.stdout: 0 0 0 0 0 0 - 0 2026-02-17T01:02:11.801 INFO:tasks.workunit.client.0.trial092.stdout: 1 15 11824 11809 46.1272 46.1289 0.00134712 0.00135279 2026-02-17T01:02:12.801 INFO:tasks.workunit.client.0.trial092.stdout: 2 16 21764 21748 42.4741 38.8242 0.00104074 0.00146968 2026-02-17T01:02:13.801 INFO:tasks.workunit.client.0.trial092.stdout: 3 16 33271 33255 43.298 44.9492 0.00101487 0.00144183 2026-02-17T01:02:14.801 INFO:tasks.workunit.client.0.trial092.stdout: 4 16 44779 44763 43.7112 44.9531 0.00119939 0.00142826 2026-02-17T01:02:15.801 INFO:tasks.workunit.client.0.trial092.stdout: 5 16 56213 56197 43.9011 44.6641 0.00137682 0.00142209 2026-02-17T01:02:16.801 INFO:tasks.workunit.client.0.trial092.stdout: 6 16 67171 67155 43.7178 42.8047 0.000982981 0.00142822 2026-02-17T01:02:17.801 INFO:tasks.workunit.client.0.trial092.stdout: 7 16 78428 78412 43.7537 43.9727 0.0021954 0.00142704 2026-02-17T01:02:18.802 INFO:tasks.workunit.client.0.trial092.stdout: 8 16 89697 89681 43.7865 44.0195 0.00381129 0.00142581 2026-02-17T01:02:19.801 INFO:tasks.workunit.client.0.trial092.stdout: 9 16 101113 101097 43.8758 44.5938 0.0015287 0.00142308 2026-02-17T01:02:20.801 INFO:tasks.workunit.client.0.trial092.stdout: 10 16 112254 112238 43.8398 43.5195 0.000981038 0.00142428 2026-02-17T01:02:21.802 INFO:tasks.workunit.client.0.trial092.stdout: 11 16 123336 123320 43.7892 43.2891 0.00105847 0.0014259 2026-02-17T01:02:22.802 INFO:tasks.workunit.client.0.trial092.stdout: 12 16 133869 133853 43.5686 41.1445 0.0234553 0.00143164 2026-02-17T01:02:23.802 INFO:tasks.workunit.client.0.trial092.stdout: 13 16 133983 133967 40.2514 0.445312 0.0914816 0.00154437 2026-02-17T01:02:24.802 INFO:tasks.workunit.client.0.trial092.stdout: 14 16 138072 138056 38.5172 15.9727 0.00144624 0.00162128 2026-02-17T01:02:25.802 INFO:tasks.workunit.client.0.trial092.stdout: 15 16 148611 148595 38.6937 41.168 0.00125289 0.00161389 2026-02-17T01:02:26.802 INFO:tasks.workunit.client.0.trial092.stdout: 16 16 159201 159185 38.8606 41.3672 0.000580827 0.00160685 2026-02-17T01:02:27.802 INFO:tasks.workunit.client.0.trial092.stdout: 17 16 169706 169690 38.9883 41.0352 0.00200701 0.00160171 2026-02-17T01:02:28.802 INFO:tasks.workunit.client.0.trial092.stdout: 18 16 180045 180029 39.0658 40.3867 0.00117261 0.00159848 2026-02-17T01:02:29.802 INFO:tasks.workunit.client.0.trial092.stdout: 19 16 186507 186491 38.3381 25.2422 0.0797442 0.00162563 2026-02-17T01:02:30.802 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T01:02:30.804528+0000 min lat: 0.000437501 max lat: 0.232878 avg lat: 0.00168738 2026-02-17T01:02:30.803 INFO:tasks.workunit.client.0.trial092.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T01:02:30.803 INFO:tasks.workunit.client.0.trial092.stdout: 20 16 189519 189503 37.0095 11.7656 0.00111099 0.00168738 2026-02-17T01:02:31.803 INFO:tasks.workunit.client.0.trial092.stdout: 21 16 199922 199906 37.182 40.6367 0.00139259 0.00167958 2026-02-17T01:02:32.803 INFO:tasks.workunit.client.0.trial092.stdout: 22 16 210390 210374 37.3505 40.8906 0.000978854 0.001672 2026-02-17T01:02:33.803 INFO:tasks.workunit.client.0.trial092.stdout: 23 16 221013 220997 37.5306 41.4961 0.00158547 0.00166397 2026-02-17T01:02:34.802 INFO:tasks.workunit.client.0.trial092.stdout: 24 16 231498 231482 37.6732 40.957 0.00101975 0.00165764 2026-02-17T01:02:35.803 INFO:tasks.workunit.client.0.trial092.stdout: 25 16 239271 239255 37.3807 30.3633 0.108954 0.00166787 2026-02-17T01:02:36.803 INFO:tasks.workunit.client.0.trial092.stdout: 26 16 239409 239393 35.9637 0.539062 0.139813 0.00173353 2026-02-17T01:02:37.803 INFO:tasks.workunit.client.0.trial092.stdout: 27 16 239957 239941 34.711 2.14062 0.0014293 0.00179924 2026-02-17T01:02:38.803 INFO:tasks.workunit.client.0.trial092.stdout: 28 16 250508 250492 34.9432 41.2148 0.00167267 0.00178729 2026-02-17T01:02:39.803 INFO:tasks.workunit.client.0.trial092.stdout: 29 16 260981 260965 35.1489 40.9102 0.00114836 0.00177682 2026-02-17T01:02:40.803 INFO:tasks.workunit.client.0.trial092.stdout:Total time run: 30.0008 2026-02-17T01:02:40.803 INFO:tasks.workunit.client.0.trial092.stdout:Total writes made: 271376 2026-02-17T01:02:40.804 INFO:tasks.workunit.client.0.trial092.stdout:Write size: 4096 2026-02-17T01:02:40.804 INFO:tasks.workunit.client.0.trial092.stdout:Object size: 4096 2026-02-17T01:02:40.804 INFO:tasks.workunit.client.0.trial092.stdout:Bandwidth (MB/sec): 35.3345 2026-02-17T01:02:40.804 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Bandwidth: 14.3487 2026-02-17T01:02:40.804 INFO:tasks.workunit.client.0.trial092.stdout:Max bandwidth (MB/sec): 46.1289 2026-02-17T01:02:40.804 INFO:tasks.workunit.client.0.trial092.stdout:Min bandwidth (MB/sec): 0.445312 2026-02-17T01:02:40.804 INFO:tasks.workunit.client.0.trial092.stdout:Average IOPS: 9045 2026-02-17T01:02:40.804 INFO:tasks.workunit.client.0.trial092.stdout:Stddev IOPS: 3673.26 2026-02-17T01:02:40.804 INFO:tasks.workunit.client.0.trial092.stdout:Max IOPS: 11809 2026-02-17T01:02:40.804 INFO:tasks.workunit.client.0.trial092.stdout:Min IOPS: 114 2026-02-17T01:02:40.804 INFO:tasks.workunit.client.0.trial092.stdout:Average Latency(s): 0.0017675 2026-02-17T01:02:40.805 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Latency(s): 0.00616545 2026-02-17T01:02:40.805 INFO:tasks.workunit.client.0.trial092.stdout:Max latency(s): 0.232878 2026-02-17T01:02:40.805 INFO:tasks.workunit.client.0.trial092.stdout:Min latency(s): 0.000437501 2026-02-17T01:02:40.806 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 139381 2026-02-17T01:02:40.806 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: sleep 1 2026-02-17T01:02:41.807 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 139381 2026-02-17T01:02:41.808 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 234: kill: (139381) - No such process 2026-02-17T01:02:41.808 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:235: TEST_bluestore: ceph osd down 0 2026-02-17T01:02:42.037 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already down. 2026-02-17T01:02:42.045 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 140583 2026-02-17T01:02:42.045 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: sleep 1 2026-02-17T01:02:43.046 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 140583 2026-02-17T01:02:43.046 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 236: kill: (140583) - No such process 2026-02-17T01:02:43.046 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:237: TEST_bluestore: ceph osd down 1 2026-02-17T01:02:43.314 INFO:tasks.workunit.client.0.trial092.stderr:osd.1 is already down. 2026-02-17T01:02:43.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 141629 2026-02-17T01:02:43.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: sleep 1 2026-02-17T01:02:44.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 141629 2026-02-17T01:02:44.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 238: kill: (141629) - No such process 2026-02-17T01:02:44.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:239: TEST_bluestore: ceph osd down 2 2026-02-17T01:02:44.552 INFO:tasks.workunit.client.0.trial092.stderr:osd.2 is already down. 2026-02-17T01:02:44.559 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 142649 2026-02-17T01:02:44.559 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: sleep 1 2026-02-17T01:02:45.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 142649 2026-02-17T01:02:45.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 240: kill: (142649) - No such process 2026-02-17T01:02:45.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:241: TEST_bluestore: ceph osd down 3 2026-02-17T01:02:45.842 INFO:tasks.workunit.client.0.trial092.stderr:osd.3 is already down. 2026-02-17T01:02:45.849 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:244: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T01:02:49.916 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:02:49.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:246: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/db2 count=1024 bs=1M 2026-02-17T01:02:50.389 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records in 2026-02-17T01:02:50.389 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records out 2026-02-17T01:02:50.389 INFO:tasks.workunit.client.0.trial092.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.422842 s, 2.5 GB/s 2026-02-17T01:02:50.389 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:247: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/db2 --command bluefs-bdev-migrate 2026-02-17T01:02:50.398 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:02:54.281 INFO:tasks.workunit.client.0.trial092.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-17T01:02:54.281 INFO:tasks.workunit.client.0.trial092.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/db2 2026-02-17T01:02:54.303 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:252: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T01:02:58.413 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:02:58.460 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:256: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal2 count=512 bs=1M 2026-02-17T01:02:58.675 INFO:tasks.workunit.client.0.trial092.stderr:512+0 records in 2026-02-17T01:02:58.676 INFO:tasks.workunit.client.0.trial092.stderr:512+0 records out 2026-02-17T01:02:58.676 INFO:tasks.workunit.client.0.trial092.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.214658 s, 2.5 GB/s 2026-02-17T01:02:58.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:257: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/wal2 --command bluefs-bdev-migrate 2026-02-17T01:02:58.686 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:03:02.958 INFO:tasks.workunit.client.0.trial092.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-17T01:03:02.958 INFO:tasks.workunit.client.0.trial092.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal2 2026-02-17T01:03:02.981 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:261: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/0/wal 2026-02-17T01:03:03.044 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:263: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T01:03:07.086 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:03:07.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:266: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-17T01:03:10.837 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:03:10.885 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:268: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db2 count=1024 bs=1M 2026-02-17T01:03:11.303 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records in 2026-02-17T01:03:11.303 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records out 2026-02-17T01:03:11.304 INFO:tasks.workunit.client.0.trial092.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.416817 s, 2.6 GB/s 2026-02-17T01:03:11.304 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:269: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --devs-source td/osd-bluefs-volume-ops/1/block.wal --dev-target td/osd-bluefs-volume-ops/1/db2 --command bluefs-bdev-migrate 2026-02-17T01:03:11.314 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:03:15.304 INFO:tasks.workunit.client.0.trial092.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-17T01:03:15.304 INFO:tasks.workunit.client.0.trial092.stdout: device removed:0 td/osd-bluefs-volume-ops/1/block.wal 2026-02-17T01:03:15.304 INFO:tasks.workunit.client.0.trial092.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db2 2026-02-17T01:03:15.329 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:275: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db 2026-02-17T01:03:15.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:277: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-17T01:03:19.134 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:03:19.183 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:279: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-17T01:03:19.193 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:03:22.374 INFO:tasks.workunit.client.0.trial092.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-17T01:03:22.394 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:284: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db2 2026-02-17T01:03:22.520 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:286: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-17T01:03:26.153 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:03:26.197 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:289: TEST_bluestore: ceph-objectstore-tool --type bluestore --data-path td/osd-bluefs-volume-ops/2 --op fsck --no-mon-config 2026-02-17T01:03:29.654 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:03:29.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:292: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-17T01:03:30.115 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records in 2026-02-17T01:03:30.116 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records out 2026-02-17T01:03:30.116 INFO:tasks.workunit.client.0.trial092.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.412976 s, 2.6 GB/s 2026-02-17T01:03:30.116 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:293: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-17T01:03:30.125 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:03:30.173 INFO:tasks.workunit.client.0.trial092.stderr:Unable to migrate Slow volume to new location, please allocate new DB or WAL with --bluefs-bdev-new-db(wal) command 2026-02-17T01:03:30.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:299: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-17T01:03:30.175 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:302: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-17T01:03:33.601 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:03:33.646 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:305: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-17T01:03:34.916 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records in 2026-02-17T01:03:34.917 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records out 2026-02-17T01:03:34.917 INFO:tasks.workunit.client.0.trial092.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 1.13141 s, 949 MB/s 2026-02-17T01:03:34.917 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:307: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --devs-source td/osd-bluefs-volume-ops/2/block.db --devs-source td/osd-bluefs-volume-ops/2/block.wal --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-17T01:03:34.926 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:03:37.991 INFO:tasks.workunit.client.0.trial092.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-17T01:03:37.991 INFO:tasks.workunit.client.0.trial092.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-17T01:03:37.992 INFO:tasks.workunit.client.0.trial092.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/2/db2 2026-02-17T01:03:38.017 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:314: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-17T01:03:41.428 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:03:41.472 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:317: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/3/wal2 count=1024 bs=1M 2026-02-17T01:03:41.887 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records in 2026-02-17T01:03:41.888 INFO:tasks.workunit.client.0.trial092.stderr:1024+0 records out 2026-02-17T01:03:41.888 INFO:tasks.workunit.client.0.trial092.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.414325 s, 2.6 GB/s 2026-02-17T01:03:41.888 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:319: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/wal2 --command bluefs-bdev-migrate 2026-02-17T01:03:41.898 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:03:45.627 INFO:tasks.workunit.client.0.trial092.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block 2026-02-17T01:03:45.627 INFO:tasks.workunit.client.0.trial092.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-17T01:03:45.627 INFO:tasks.workunit.client.0.trial092.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/3/wal2 2026-02-17T01:03:45.652 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:325: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-17T01:03:49.104 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:03:49.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:327: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-17T01:03:49.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:03:49.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:03:49.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T01:03:49.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:03:49.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-17T01:03:49.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:03:49.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:03:49.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:03:49.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:03:49.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-17T01:03:49.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-17T01:03:49.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:03:49.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:03:49.162 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:03:49.162 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:03:49.162 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:03:49.162 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:03:49.162 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:03:49.162 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:03:49.162 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:03:49.162 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:03:49.162 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:03:49.162 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:03:49.162 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:03:49.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:03:49.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:03:49.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:03:49.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:03:49.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:03:49.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:03:49.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:03:49.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-17T01:03:49.163 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T01:03:49.164 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T01:03:49.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:03:49.165 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-17T01:03:49.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T01:03:49.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:03:49.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:03:49.165 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:03:49.173 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:03:49.174+0000 7fbce3039780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:03:49.174 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:03:49.175+0000 7fbce3039780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:03:49.175 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:03:49.176+0000 7fbce3039780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:03:49.345 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:03:49.346+0000 7fbce3039780 -1 Falling back to public interface 2026-02-17T01:03:49.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T01:03:49.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:03:49.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T01:03:49.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:03:49.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:03:49.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:03:49.393 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:03:49.394 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:03:49.394 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:03:49.395 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:03:49.619 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:03:50.620 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:03:50.620 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:03:50.620 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:03:50.620 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:03:50.620 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:03:50.620 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:03:50.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:03:51.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:03:51.853 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:03:51.854 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:03:51.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:03:51.854 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:03:51.855 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:03:52.087 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:03:53.088 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:03:53.088 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:03:53.088 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T01:03:53.088 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-17T01:03:53.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:03:53.089 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:03:53.315 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:03:54.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:03:54.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:03:54.317 INFO:tasks.workunit.client.0.trial092.stdout:4 2026-02-17T01:03:54.318 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-17T01:03:54.318 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:03:54.318 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:03:54.549 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:03:55.550 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:03:55.550 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:03:55.550 INFO:tasks.workunit.client.0.trial092.stdout:5 2026-02-17T01:03:55.550 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-17T01:03:55.550 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:03:55.550 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:03:55.781 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:03:56.782 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:03:56.783 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:03:56.783 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-17T01:03:56.783 INFO:tasks.workunit.client.0.trial092.stdout:6 2026-02-17T01:03:56.784 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:03:56.784 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:03:57.022 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:03:57.191 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:03:57.192+0000 7fbce3039780 -1 osd.0 65 log_to_monitors true 2026-02-17T01:03:58.024 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:03:58.025 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:03:58.025 INFO:tasks.workunit.client.0.trial092.stdout:7 2026-02-17T01:03:58.026 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-17T01:03:58.026 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:03:58.027 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:03:58.250 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 73 up_thru 73 down_at 65 last_clean_interval [53,65) [v2:127.0.0.1:6800/178297196,v1:127.0.0.1:6801/178297196] [v2:127.0.0.1:6802/178297196,v1:127.0.0.1:6803/178297196] exists,up acd97186-aaca-45b8-ae31-942f7123432f 2026-02-17T01:03:58.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:03:58.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:03:58.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:03:58.252 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-17T01:03:58.255 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: osd_pid0=149824 2026-02-17T01:03:58.255 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:329: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-17T01:03:58.255 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:03:58.255 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:03:58.255 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-17T01:03:58.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:03:58.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-17T01:03:58.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:03:58.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:03:58.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:03:58.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:03:58.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-17T01:03:58.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-17T01:03:58.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:03:58.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:03:58.256 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:03:58.257 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:03:58.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:03:58.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:03:58.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:03:58.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:03:58.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-17T01:03:58.258 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-17T01:03:58.258 INFO:tasks.workunit.client.0.trial092.stdout:start osd.1 2026-02-17T01:03:58.259 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:03:58.259 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-17T01:03:58.260 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-17T01:03:58.260 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:03:58.260 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:03:58.260 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:03:58.268 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:03:58.270+0000 7f7539871780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:03:58.269 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:03:58.271+0000 7f7539871780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:03:58.270 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:03:58.272+0000 7f7539871780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:03:58.403 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:03:58.404+0000 7f7539871780 -1 Falling back to public interface 2026-02-17T01:03:58.480 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-17T01:03:58.480 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:03:58.480 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-17T01:03:58.480 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:03:58.480 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:03:58.480 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:03:58.480 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:03:58.481 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:03:58.481 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:03:58.481 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:03:58.705 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:03:59.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:03:59.707 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:03:59.707 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:03:59.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:03:59.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:03:59.708 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:03:59.935 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:00.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:00.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:00.936 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:04:00.937 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:04:00.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:00.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:04:01.169 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:02.170 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:02.170 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:02.170 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T01:04:02.171 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-17T01:04:02.171 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:02.171 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:04:02.401 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:03.402 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:03.402 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:03.402 INFO:tasks.workunit.client.0.trial092.stdout:4 2026-02-17T01:04:03.403 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-17T01:04:03.403 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:03.403 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:04:03.637 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:04.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:04.638 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:04.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-17T01:04:04.639 INFO:tasks.workunit.client.0.trial092.stdout:5 2026-02-17T01:04:04.639 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:04.640 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:04:04.869 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:05.349 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:04:05.350+0000 7f7539871780 -1 osd.1 67 log_to_monitors true 2026-02-17T01:04:05.870 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:05.871 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:05.871 INFO:tasks.workunit.client.0.trial092.stdout:6 2026-02-17T01:04:05.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-17T01:04:05.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:05.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-17T01:04:06.098 INFO:tasks.workunit.client.0.trial092.stdout:osd.1 up in weight 1 up_from 76 up_thru 76 down_at 67 last_clean_interval [56,67) [v2:127.0.0.1:6810/2651619727,v1:127.0.0.1:6811/2651619727] [v2:127.0.0.1:6812/2651619727,v1:127.0.0.1:6813/2651619727] exists,up 4081cf48-22d6-40a5-8af4-1d30e1c6dfab 2026-02-17T01:04:06.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:04:06.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:04:06.099 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:04:06.099 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-17T01:04:06.100 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: osd_pid1=150895 2026-02-17T01:04:06.100 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:331: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-17T01:04:06.100 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:04:06.100 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:04:06.100 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-17T01:04:06.100 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:04:06.101 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:04:06.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:04:06.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:04:06.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:04:06.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:04:06.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:04:06.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:04:06.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:04:06.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:04:06.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:04:06.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:04:06.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-17T01:04:06.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-17T01:04:06.103 INFO:tasks.workunit.client.0.trial092.stdout:start osd.2 2026-02-17T01:04:06.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:04:06.103 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-17T01:04:06.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-17T01:04:06.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:04:06.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:04:06.104 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:04:06.117 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:04:06.118+0000 7fe37e00f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:04:06.118 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:04:06.120+0000 7fe37e00f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:04:06.119 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:04:06.121+0000 7fe37e00f780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:04:06.277 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:04:06.279+0000 7fe37e00f780 -1 Falling back to public interface 2026-02-17T01:04:06.332 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-17T01:04:06.332 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:04:06.332 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-17T01:04:06.332 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:04:06.332 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:04:06.332 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:06.332 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:04:06.333 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:04:06.333 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:06.333 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:04:06.560 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:07.561 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:07.562 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:07.562 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:04:07.563 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:04:07.563 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:07.563 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:04:07.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:08.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:08.795 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:08.795 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:04:08.796 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:04:08.796 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:08.796 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:04:09.027 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:10.028 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:10.028 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:10.028 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T01:04:10.028 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-17T01:04:10.028 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:10.028 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:04:10.263 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:11.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:11.264 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:11.264 INFO:tasks.workunit.client.0.trial092.stdout:4 2026-02-17T01:04:11.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-17T01:04:11.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:11.265 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:04:11.494 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:12.496 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:12.497 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:12.497 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-17T01:04:12.497 INFO:tasks.workunit.client.0.trial092.stdout:5 2026-02-17T01:04:12.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:12.498 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:04:12.678 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:04:12.678+0000 7fe37e00f780 -1 osd.2 68 log_to_monitors true 2026-02-17T01:04:12.734 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:13.735 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:13.736 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:13.736 INFO:tasks.workunit.client.0.trial092.stdout:6 2026-02-17T01:04:13.737 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-17T01:04:13.737 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:13.737 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-17T01:04:13.964 INFO:tasks.workunit.client.0.trial092.stdout:osd.2 up in weight 1 up_from 80 up_thru 80 down_at 69 last_clean_interval [59,68) [v2:127.0.0.1:6818/2249183955,v1:127.0.0.1:6819/2249183955] [v2:127.0.0.1:6820/2249183955,v1:127.0.0.1:6821/2249183955] exists,up 775dc709-a3a2-42e4-8015-e267c398fc94 2026-02-17T01:04:13.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:04:13.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:04:13.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:04:13.965 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-17T01:04:13.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: osd_pid2=151930 2026-02-17T01:04:13.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:333: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-17T01:04:13.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:04:13.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:04:13.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-17T01:04:13.969 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 ' 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:04:13.970 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:04:13.971 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:04:13.972 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:04:13.972 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:04:13.972 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:04:13.972 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-17T01:04:13.972 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-17T01:04:13.972 INFO:tasks.workunit.client.0.trial092.stdout:start osd.3 2026-02-17T01:04:13.973 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:04:13.973 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-17T01:04:13.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-17T01:04:13.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:04:13.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:04:13.974 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:04:13.981 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:04:13.982+0000 7fc51b652780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:04:13.983 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:04:13.983+0000 7fc51b652780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:04:13.983 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:04:13.984+0000 7fc51b652780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:04:14.147 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:04:14.148+0000 7fc51b652780 -1 Falling back to public interface 2026-02-17T01:04:14.202 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-17T01:04:14.203 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:04:14.203 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-17T01:04:14.203 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:04:14.203 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:04:14.203 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:14.204 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:04:14.204 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:04:14.204 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:14.204 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:04:14.434 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:15.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:15.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:15.435 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:04:15.435 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:04:15.436 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:15.436 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:04:15.665 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:16.666 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:16.667 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:16.667 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:04:16.668 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:04:16.668 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:16.668 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:04:16.900 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:17.901 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:17.901 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:17.901 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T01:04:17.901 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-17T01:04:17.901 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:17.901 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:04:18.131 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:19.132 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:19.133 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:19.133 INFO:tasks.workunit.client.0.trial092.stdout:4 2026-02-17T01:04:19.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-17T01:04:19.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:19.134 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:04:19.364 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:20.365 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:20.365 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:20.366 INFO:tasks.workunit.client.0.trial092.stdout:5 2026-02-17T01:04:20.366 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-17T01:04:20.366 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:20.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:04:20.600 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:04:20.681 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:04:20.681+0000 7fc51b652780 -1 osd.3 70 log_to_monitors true 2026-02-17T01:04:21.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:04:21.601 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:04:21.602 INFO:tasks.workunit.client.0.trial092.stdout:6 2026-02-17T01:04:21.602 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-17T01:04:21.602 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:04:21.602 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-17T01:04:21.827 INFO:tasks.workunit.client.0.trial092.stdout:osd.3 up in weight 1 up_from 84 up_thru 84 down_at 71 last_clean_interval [63,70) [v2:127.0.0.1:6826/2357546079,v1:127.0.0.1:6827/2357546079] [v2:127.0.0.1:6828/2357546079,v1:127.0.0.1:6829/2357546079] exists,up 325063f3-470c-458a-a7c8-469fe5fcda28 2026-02-17T01:04:21.828 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:04:21.828 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:04:21.828 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:04:21.828 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-17T01:04:21.829 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: osd_pid3=152970 2026-02-17T01:04:21.829 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:337: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-17T01:04:21.845 INFO:tasks.workunit.client.0.trial092.stdout:hints = 1 2026-02-17T01:04:21.845 INFO:tasks.workunit.client.0.trial092.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-17T01:04:21.845 INFO:tasks.workunit.client.0.trial092.stdout:Object prefix: benchmark_data_trial092_153996 2026-02-17T01:04:21.845 INFO:tasks.workunit.client.0.trial092.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T01:04:21.845 INFO:tasks.workunit.client.0.trial092.stdout: 0 0 0 0 0 0 - 0 2026-02-17T01:04:22.845 INFO:tasks.workunit.client.0.trial092.stdout: 1 16 12068 12052 47.0741 47.0781 0.000929764 0.00132547 2026-02-17T01:04:23.845 INFO:tasks.workunit.client.0.trial092.stdout: 2 16 24296 24280 47.418 47.7656 0.00179894 0.00131628 2026-02-17T01:04:24.846 INFO:tasks.workunit.client.0.trial092.stdout: 3 16 36192 36176 47.1003 46.4688 0.00105467 0.00132531 2026-02-17T01:04:25.845 INFO:tasks.workunit.client.0.trial092.stdout: 4 16 48065 48049 46.9191 46.3789 0.00135793 0.00133062 2026-02-17T01:04:26.846 INFO:tasks.workunit.client.0.trial092.stdout: 5 16 59724 59708 46.6427 45.543 0.000573303 0.0013382 2026-02-17T01:04:27.846 INFO:tasks.workunit.client.0.trial092.stdout: 6 16 71450 71434 46.5024 45.8047 0.00164924 0.00134258 2026-02-17T01:04:28.846 INFO:tasks.workunit.client.0.trial092.stdout: 7 16 83188 83172 46.4089 45.8516 0.00166761 0.0013453 2026-02-17T01:04:29.846 INFO:tasks.workunit.client.0.trial092.stdout: 8 16 94943 94927 46.3471 45.918 0.00106756 0.00134712 2026-02-17T01:04:30.846 INFO:tasks.workunit.client.0.trial092.stdout: 9 16 99575 99559 43.2077 18.0938 0.131421 0.00143818 2026-02-17T01:04:31.846 INFO:tasks.workunit.client.0.trial092.stdout: 10 16 103807 103791 40.54 16.5312 0.00178865 0.00154031 2026-02-17T01:04:32.846 INFO:tasks.workunit.client.0.trial092.stdout: 11 16 115314 115298 40.9405 44.9492 0.00229592 0.00152525 2026-02-17T01:04:33.846 INFO:tasks.workunit.client.0.trial092.stdout: 12 16 127087 127071 41.3608 45.9883 0.00287608 0.0015097 2026-02-17T01:04:34.846 INFO:tasks.workunit.client.0.trial092.stdout: 13 16 138234 138218 41.5285 43.543 0.00200728 0.00150363 2026-02-17T01:04:35.846 INFO:tasks.workunit.client.0.trial092.stdout: 14 16 149212 149196 41.625 42.8828 0.000935455 0.00150007 2026-02-17T01:04:36.846 INFO:tasks.workunit.client.0.trial092.stdout: 15 16 160063 160047 41.6756 42.3867 0.00123039 0.00149835 2026-02-17T01:04:37.846 INFO:tasks.workunit.client.0.trial092.stdout: 16 16 160831 160815 39.2584 3 0.0856011 0.00158652 2026-02-17T01:04:38.846 INFO:tasks.workunit.client.0.trial092.stdout: 17 16 171191 171175 39.3294 40.4688 0.00143146 0.00158782 2026-02-17T01:04:39.846 INFO:tasks.workunit.client.0.trial092.stdout: 18 16 182091 182075 39.5096 42.5781 0.00134054 0.00158058 2026-02-17T01:04:40.847 INFO:tasks.workunit.client.0.trial092.stdout: 19 16 192745 192729 39.6204 41.6172 0.00104294 0.00157614 2026-02-17T01:04:41.846 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T01:04:41.849043+0000 min lat: 0.000433484 max lat: 0.147477 avg lat: 0.00157037 2026-02-17T01:04:41.846 INFO:tasks.workunit.client.0.trial092.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T01:04:41.847 INFO:tasks.workunit.client.0.trial092.stdout: 20 16 203632 203616 39.7656 42.5273 0.0011437 0.00157037 2026-02-17T01:04:42.847 INFO:tasks.workunit.client.0.trial092.stdout: 21 16 214436 214420 39.8815 42.2031 0.00136501 0.00156582 2026-02-17T01:04:43.846 INFO:tasks.workunit.client.0.trial092.stdout: 22 16 225256 225240 39.9897 42.2656 0.00128742 0.00156155 2026-02-17T01:04:44.847 INFO:tasks.workunit.client.0.trial092.stdout: 23 16 236034 236018 40.0814 42.1016 0.000961052 0.00155801 2026-02-17T01:04:45.847 INFO:tasks.workunit.client.0.trial092.stdout: 24 16 246885 246869 40.1773 42.3867 0.00266665 0.00155428 2026-02-17T01:04:46.847 INFO:tasks.workunit.client.0.trial092.stdout: 25 16 257599 257583 40.2441 41.8516 0.00121234 0.00155169 2026-02-17T01:04:47.847 INFO:tasks.workunit.client.0.trial092.stdout: 26 16 268413 268397 40.3208 42.2422 0.0012548 0.00154874 2026-02-17T01:04:48.847 INFO:tasks.workunit.client.0.trial092.stdout: 27 16 271834 271818 39.3224 13.3633 0.129561 0.00158683 2026-02-17T01:04:49.847 INFO:tasks.workunit.client.0.trial092.stdout: 28 16 271967 271951 37.9366 0.519531 0.0801299 0.00164216 2026-02-17T01:04:50.847 INFO:tasks.workunit.client.0.trial092.stdout: 29 16 272109 272093 36.6475 0.554688 0.0871113 0.00170148 2026-02-17T01:04:51.847 INFO:tasks.workunit.client.0.trial092.stdout: 30 16 272292 272276 35.4498 0.714844 0.0337348 0.00175941 2026-02-17T01:04:52.848 INFO:tasks.workunit.client.0.trial092.stdout:Total time run: 30.1117 2026-02-17T01:04:52.848 INFO:tasks.workunit.client.0.trial092.stdout:Total writes made: 272292 2026-02-17T01:04:52.848 INFO:tasks.workunit.client.0.trial092.stdout:Write size: 4096 2026-02-17T01:04:52.848 INFO:tasks.workunit.client.0.trial092.stdout:Object size: 4096 2026-02-17T01:04:52.848 INFO:tasks.workunit.client.0.trial092.stdout:Bandwidth (MB/sec): 35.3231 2026-02-17T01:04:52.848 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Bandwidth: 16.1936 2026-02-17T01:04:52.848 INFO:tasks.workunit.client.0.trial092.stdout:Max bandwidth (MB/sec): 47.7656 2026-02-17T01:04:52.848 INFO:tasks.workunit.client.0.trial092.stdout:Min bandwidth (MB/sec): 0.519531 2026-02-17T01:04:52.848 INFO:tasks.workunit.client.0.trial092.stdout:Average IOPS: 9042 2026-02-17T01:04:52.849 INFO:tasks.workunit.client.0.trial092.stdout:Stddev IOPS: 4145.56 2026-02-17T01:04:52.849 INFO:tasks.workunit.client.0.trial092.stdout:Max IOPS: 12228 2026-02-17T01:04:52.849 INFO:tasks.workunit.client.0.trial092.stdout:Min IOPS: 133 2026-02-17T01:04:52.849 INFO:tasks.workunit.client.0.trial092.stdout:Average Latency(s): 0.00176432 2026-02-17T01:04:52.849 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Latency(s): 0.00606496 2026-02-17T01:04:52.849 INFO:tasks.workunit.client.0.trial092.stdout:Max latency(s): 0.212371 2026-02-17T01:04:52.849 INFO:tasks.workunit.client.0.trial092.stdout:Min latency(s): 0.000433484 2026-02-17T01:04:52.850 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:339: TEST_bluestore: wait_for_clean 2026-02-17T01:04:52.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T01:04:52.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T01:04:52.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T01:04:52.852 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T01:04:52.852 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T01:04:52.852 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T01:04:52.852 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T01:04:52.852 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T01:04:52.852 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T01:04:52.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T01:04:52.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T01:04:52.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T01:04:52.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T01:04:52.937 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T01:04:52.937 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T01:04:53.160 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-17T01:04:53.160 INFO:tasks.workunit.client.0.trial092.stderr:1 2026-02-17T01:04:53.161 INFO:tasks.workunit.client.0.trial092.stderr:2 2026-02-17T01:04:53.161 INFO:tasks.workunit.client.0.trial092.stderr:3' 2026-02-17T01:04:53.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T01:04:53.161 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T01:04:53.161 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T01:04:53.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=313532612622 2026-02-17T01:04:53.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 313532612622 2026-02-17T01:04:53.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612622' 2026-02-17T01:04:53.225 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T01:04:53.225 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.1 flush_pg_stats 2026-02-17T01:04:53.288 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=326417514508 2026-02-17T01:04:53.289 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 326417514508 2026-02-17T01:04:53.289 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612622 1-326417514508' 2026-02-17T01:04:53.289 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T01:04:53.289 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.2 flush_pg_stats 2026-02-17T01:04:53.353 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=343597383691 2026-02-17T01:04:53.353 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 343597383691 2026-02-17T01:04:53.353 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612622 1-326417514508 2-343597383691' 2026-02-17T01:04:53.353 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T01:04:53.354 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.3 flush_pg_stats 2026-02-17T01:04:53.415 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=360777252873 2026-02-17T01:04:53.415 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 360777252873 2026-02-17T01:04:53.415 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-313532612622 1-326417514508 2-343597383691 3-360777252873' 2026-02-17T01:04:53.415 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T01:04:53.416 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-313532612622 2026-02-17T01:04:53.416 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T01:04:53.417 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T01:04:53.417 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-313532612622 2026-02-17T01:04:53.417 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T01:04:53.418 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=313532612622 2026-02-17T01:04:53.418 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 313532612622' 2026-02-17T01:04:53.419 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 313532612622 2026-02-17T01:04:53.419 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T01:04:53.644 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612620 -lt 313532612622 2026-02-17T01:04:53.644 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T01:04:54.645 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T01:04:54.646 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T01:04:54.869 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 313532612622 -lt 313532612622 2026-02-17T01:04:54.869 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T01:04:54.869 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 1-326417514508 2026-02-17T01:04:54.869 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T01:04:54.870 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=1 2026-02-17T01:04:54.871 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-326417514508 2026-02-17T01:04:54.871 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T01:04:54.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=326417514508 2026-02-17T01:04:54.872 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.1 seq 326417514508' 2026-02-17T01:04:54.872 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.1 seq 326417514508 2026-02-17T01:04:54.872 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T01:04:55.108 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 326417514508 -lt 326417514508 2026-02-17T01:04:55.108 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T01:04:55.108 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 2-343597383691 2026-02-17T01:04:55.109 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T01:04:55.109 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=2 2026-02-17T01:04:55.110 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-343597383691 2026-02-17T01:04:55.110 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T01:04:55.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=343597383691 2026-02-17T01:04:55.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.2 seq 343597383691' 2026-02-17T01:04:55.111 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.2 seq 343597383691 2026-02-17T01:04:55.112 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T01:04:55.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 343597383691 -lt 343597383691 2026-02-17T01:04:55.336 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T01:04:55.337 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 3-360777252873 2026-02-17T01:04:55.337 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T01:04:55.337 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=3 2026-02-17T01:04:55.338 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-360777252873 2026-02-17T01:04:55.338 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T01:04:55.339 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=360777252873 2026-02-17T01:04:55.339 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.3 seq 360777252873 2026-02-17T01:04:55.340 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.3 seq 360777252873' 2026-02-17T01:04:55.340 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T01:04:55.568 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 360777252873 -lt 360777252873 2026-02-17T01:04:55.569 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T01:04:55.569 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T01:04:55.569 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T01:04:55.880 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-17T01:04:55.881 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T01:04:55.881 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T01:04:55.881 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T01:04:55.881 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T01:04:55.881 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T01:04:55.881 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T01:04:55.881 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T01:04:56.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-17T01:04:56.102 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T01:04:56.103 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T01:04:56.103 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T01:04:56.417 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-17T01:04:56.417 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T01:04:56.417 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T01:04:56.417 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-17T01:04:56.418 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:04:56.418 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T01:04:56.418 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T01:04:56.418 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T01:04:56.418 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T01:04:56.418 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T01:04:56.418 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T01:04:56.418 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T01:04:56.727 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T01:04:56.727 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T01:04:56.728 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T01:04:56.728 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T01:04:56.730 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T01:04:56.730 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T01:04:56.731 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T01:04:56.732 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T01:04:56.732 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T01:04:56.732 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T01:04:56.732 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T01:04:56.733 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T01:04:56.734 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T01:04:56.734 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T01:05:02.948 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T01:05:02.948 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:02.948 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:02.948 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.109301 2026-02-17T01:05:02.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T01:05:02.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T01:05:02.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-17T01:05:02.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-17T01:05:02.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:02.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-17T01:05:02.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:02.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T01:05:02.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T01:05:02.950 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T01:05:02.950 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T01:05:02.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T01:05:02.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T01:05:02.950 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T01:05:02.951 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T01:05:02.952 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T01:05:02.952 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T01:05:02.953 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T01:05:02.954 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T01:05:02.954 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T01:05:02.954 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T01:05:02.955 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T01:05:02.955 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T01:05:02.955 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T01:05:02.955 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T01:05:02.956 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T01:05:02.957 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T01:05:02.957 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T01:05:02.958 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T01:05:02.958 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:02.958 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:02.958 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.109301 2026-02-17T01:05:02.959 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T01:05:02.959 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T01:05:02.959 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-17T01:05:02.960 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T01:05:02.960 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:02.960 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:02.961 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.109301 2026-02-17T01:05:02.962 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T01:05:02.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T01:05:02.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T01:05:02.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-17T01:05:02.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore2 td/osd-bluefs-volume-ops 2026-02-17T01:05:02.962 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:343: TEST_bluestore2: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:02.962 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: ulimit -n 2026-02-17T01:05:02.963 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: local flimit=4096 2026-02-17T01:05:02.963 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:346: TEST_bluestore2: '[' 4096 -lt 1536 ']' 2026-02-17T01:05:02.963 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: export CEPH_MON=127.0.0.1:7146 2026-02-17T01:05:02.963 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: CEPH_MON=127.0.0.1:7146 2026-02-17T01:05:02.963 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:350: TEST_bluestore2: export CEPH_ARGS 2026-02-17T01:05:02.963 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: uuidgen 2026-02-17T01:05:02.964 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: CEPH_ARGS+='--fsid=a534615a-caed-4b01-ba5a-82e24d534b92 --auth-supported=none ' 2026-02-17T01:05:02.964 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:352: TEST_bluestore2: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:353: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:354: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:355: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:356: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:357: TEST_bluestore2: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:358: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:359: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:360: TEST_bluestore2: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:362: TEST_bluestore2: run_mon td/osd-bluefs-volume-ops a 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-17T01:05:02.965 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:02.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T01:05:02.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:05:02.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:05:02.986 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:05:02.986 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:02.986 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:02.986 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:05:02.986 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T01:05:03.012 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T01:05:03.013 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T01:05:03.013 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T01:05:03.013 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T01:05:03.013 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T01:05:03.013 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T01:05:03.013 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T01:05:03.013 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T01:05:03.013 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T01:05:03.014 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T01:05:03.014 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:03.014 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:03.014 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.109301/ceph-mon.a.asok 2026-02-17T01:05:03.014 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T01:05:03.014 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.109301/ceph-mon.a.asok config get fsid 2026-02-17T01:05:03.057 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T01:05:03.057 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T01:05:03.057 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T01:05:03.057 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T01:05:03.057 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T01:05:03.058 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T01:05:03.058 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T01:05:03.058 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T01:05:03.058 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T01:05:03.058 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:03.058 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:03.058 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.109301/ceph-mon.a.asok 2026-02-17T01:05:03.059 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T01:05:03.059 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.109301/ceph-mon.a.asok config get mon_host 2026-02-17T01:05:03.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:363: TEST_bluestore2: run_mgr td/osd-bluefs-volume-ops x 2026-02-17T01:05:03.102 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:03.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T01:05:03.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T01:05:03.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T01:05:03.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-17T01:05:03.103 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T01:05:03.207 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T01:05:03.207 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:05:03.207 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:05:03.207 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:05:03.207 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:03.207 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:03.208 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:05:03.208 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T01:05:03.209 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T01:05:03.226 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:364: TEST_bluestore2: run_osd td/osd-bluefs-volume-ops 0 2026-02-17T01:05:03.226 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:03.226 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T01:05:03.226 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T01:05:03.226 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T01:05:03.226 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-17T01:05:03.226 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=a534615a-caed-4b01-ba5a-82e24d534b92 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:03.227 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:03.228 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:05:03.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:05:03.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:05:03.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T01:05:03.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T01:05:03.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:05:03.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:05:03.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:05:03.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:05:03.228 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:05:03.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:05:03.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T01:05:03.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T01:05:03.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-17T01:05:03.229 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T01:05:03.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6f11f03b-2aec-4550-b2cc-b0e0c2e465c4 2026-02-17T01:05:03.229 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6f11f03b-2aec-4550-b2cc-b0e0c2e465c4' 2026-02-17T01:05:03.229 INFO:tasks.workunit.client.0.trial092.stdout:add osd0 6f11f03b-2aec-4550-b2cc-b0e0c2e465c4 2026-02-17T01:05:03.229 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T01:05:03.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQC/vpNpBv5sDhAA23Ijlsf4l/R0ggZ7kzOXgA== 2026-02-17T01:05:03.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQC/vpNpBv5sDhAA23Ijlsf4l/R0ggZ7kzOXgA=="}' 2026-02-17T01:05:03.240 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6f11f03b-2aec-4550-b2cc-b0e0c2e465c4 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-17T01:05:03.347 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:05:03.353 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-17T01:05:03.354 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=a534615a-caed-4b01-ba5a-82e24d534b92 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC/vpNpBv5sDhAA23Ijlsf4l/R0ggZ7kzOXgA== --osd-uuid 6f11f03b-2aec-4550-b2cc-b0e0c2e465c4 2026-02-17T01:05:03.374 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:03.375+0000 7f95aa441780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:03.375 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:03.377+0000 7f95aa441780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:03.376 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:03.378+0000 7f95aa441780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:03.376 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:03.378+0000 7f95aa441780 -1 bdev(0x3c8c000 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-17T01:05:03.377 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:03.378+0000 7f95aa441780 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-17T01:05:04.110 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-17T01:05:04.110 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T01:05:04.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T01:05:04.111 INFO:tasks.workunit.client.0.trial092.stdout:adding osd0 key to auth repository 2026-02-17T01:05:04.111 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T01:05:04.217 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T01:05:04.218 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T01:05:04.218 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=a534615a-caed-4b01-ba5a-82e24d534b92 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:05:04.219 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T01:05:04.219 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T01:05:04.219 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T01:05:04.235 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:04.237+0000 7f73e1053780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:04.237 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:04.239+0000 7f73e1053780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:04.237 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:04.239+0000 7f73e1053780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:04.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T01:05:04.320 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:05:04.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T01:05:04.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:05:04.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:05:04.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:05:04.321 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:05:04.321 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:05:04.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:05:04.322 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:05:04.420 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:05:04.489 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:04.491+0000 7f73e1053780 -1 Falling back to public interface 2026-02-17T01:05:05.139 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:05.140+0000 7f73e1053780 -1 osd.0 0 log_to_monitors true 2026-02-17T01:05:05.421 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:05:05.422 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:05:05.422 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:05:05.422 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:05:05.423 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:05:05.423 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:05:05.653 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:05:06.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:05:06.655 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:05:06.655 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:05:06.656 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:05:06.656 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:05:06.656 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:05:06.883 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3146699046,v1:127.0.0.1:6801/3146699046] [v2:127.0.0.1:6802/3146699046,v1:127.0.0.1:6803/3146699046] exists,up 6f11f03b-2aec-4550-b2cc-b0e0c2e465c4 2026-02-17T01:05:06.884 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:05:06.884 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:05:06.884 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:05:06.884 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-17T01:05:06.885 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: osd_pid0=155831 2026-02-17T01:05:06.885 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:367: TEST_bluestore2: sleep 5 2026-02-17T01:05:11.887 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:368: TEST_bluestore2: create_pool foo 16 2026-02-17T01:05:11.887 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-17T01:05:12.163 INFO:tasks.workunit.client.0.trial092.stderr:pool 'foo' already exists 2026-02-17T01:05:12.171 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T01:05:13.172 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:370: TEST_bluestore2: retry = 0 2026-02-17T01:05:13.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 370: retry: command not found 2026-02-17T01:05:13.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:371: TEST_bluestore2: [[ '' -le 5 ]] 2026-02-17T01:05:13.173 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:373: TEST_bluestore2: timeout 60 rados bench -p foo 10 write --write-omap --no-cleanup 2026-02-17T01:05:13.194 INFO:tasks.workunit.client.0.trial092.stdout:hints = 1 2026-02-17T01:05:13.195 INFO:tasks.workunit.client.0.trial092.stdout:Maintaining 16 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 10 seconds or 0 objects 2026-02-17T01:05:13.195 INFO:tasks.workunit.client.0.trial092.stdout:Object prefix: benchmark_data_trial092_157242 2026-02-17T01:05:13.214 INFO:tasks.workunit.client.0.trial092.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T01:05:13.214 INFO:tasks.workunit.client.0.trial092.stdout: 0 0 0 0 0 0 - 0 2026-02-17T01:05:14.214 INFO:tasks.workunit.client.0.trial092.stdout: 1 16 181 165 659.945 660 0.0960358 0.0897685 2026-02-17T01:05:15.214 INFO:tasks.workunit.client.0.trial092.stdout: 2 16 389 373 745.94 832 0.0825563 0.0847108 2026-02-17T01:05:16.215 INFO:tasks.workunit.client.0.trial092.stdout: 3 16 577 561 747.941 752 0.0870001 0.0845651 2026-02-17T01:05:17.215 INFO:tasks.workunit.client.0.trial092.stdout: 4 16 757 741 740.943 720 0.0876761 0.0846841 2026-02-17T01:05:18.215 INFO:tasks.workunit.client.0.trial092.stdout: 5 16 965 949 759.142 832 0.0858928 0.0832129 2026-02-17T01:05:19.215 INFO:tasks.workunit.client.0.trial092.stdout: 6 16 1169 1153 768.608 816 0.0658659 0.0828193 2026-02-17T01:05:20.215 INFO:tasks.workunit.client.0.trial092.stdout: 7 16 1345 1329 759.37 704 0.0975485 0.0838549 2026-02-17T01:05:21.215 INFO:tasks.workunit.client.0.trial092.stdout: 8 16 1541 1525 762.441 784 0.0847576 0.0831886 2026-02-17T01:05:22.215 INFO:tasks.workunit.client.0.trial092.stdout: 9 16 1749 1733 770.164 832 0.0704543 0.0826662 2026-02-17T01:05:23.215 INFO:tasks.workunit.client.0.trial092.stdout: 10 16 1941 1925 769.942 768 0.0820878 0.0827981 2026-02-17T01:05:24.215 INFO:tasks.workunit.client.0.trial092.stdout:Total time run: 10.059 2026-02-17T01:05:24.216 INFO:tasks.workunit.client.0.trial092.stdout:Total writes made: 1941 2026-02-17T01:05:24.216 INFO:tasks.workunit.client.0.trial092.stdout:Write size: 4194304 2026-02-17T01:05:24.216 INFO:tasks.workunit.client.0.trial092.stdout:Object size: 4194304 2026-02-17T01:05:24.216 INFO:tasks.workunit.client.0.trial092.stdout:Bandwidth (MB/sec): 771.844 2026-02-17T01:05:24.216 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Bandwidth: 60.6703 2026-02-17T01:05:24.216 INFO:tasks.workunit.client.0.trial092.stdout:Max bandwidth (MB/sec): 832 2026-02-17T01:05:24.216 INFO:tasks.workunit.client.0.trial092.stdout:Min bandwidth (MB/sec): 660 2026-02-17T01:05:24.216 INFO:tasks.workunit.client.0.trial092.stdout:Average IOPS: 192 2026-02-17T01:05:24.216 INFO:tasks.workunit.client.0.trial092.stdout:Stddev IOPS: 15.1676 2026-02-17T01:05:24.216 INFO:tasks.workunit.client.0.trial092.stdout:Max IOPS: 208 2026-02-17T01:05:24.216 INFO:tasks.workunit.client.0.trial092.stdout:Min IOPS: 165 2026-02-17T01:05:24.217 INFO:tasks.workunit.client.0.trial092.stdout:Average Latency(s): 0.0828129 2026-02-17T01:05:24.217 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Latency(s): 0.0101938 2026-02-17T01:05:24.217 INFO:tasks.workunit.client.0.trial092.stdout:Max latency(s): 0.111132 2026-02-17T01:05:24.217 INFO:tasks.workunit.client.0.trial092.stdout:Min latency(s): 0.0243241 2026-02-17T01:05:24.224 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:376: TEST_bluestore2: sleep 10 2026-02-17T01:05:34.226 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-17T01:05:34.227 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: jq .bluefs.db_used_bytes 2026-02-17T01:05:34.297 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: db_used=1034944512 2026-02-17T01:05:34.298 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-17T01:05:34.298 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: jq .bluefs.slow_used_bytes 2026-02-17T01:05:34.366 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: spilled_over=128188416 2026-02-17T01:05:34.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:380: TEST_bluestore2: (( retry+=1 )) 2026-02-17T01:05:34.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: test 128188416 -eq 0 2026-02-17T01:05:34.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: break 2026-02-17T01:05:34.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:383: TEST_bluestore2: test 128188416 -gt 0 2026-02-17T01:05:34.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 155831 2026-02-17T01:05:34.367 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: sleep 1 2026-02-17T01:05:35.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 155831 2026-02-17T01:05:35.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 385: kill: (155831) - No such process 2026-02-17T01:05:35.368 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:386: TEST_bluestore2: ceph osd down 0 2026-02-17T01:05:35.603 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already down. 2026-02-17T01:05:35.610 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:388: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/block --command bluefs-bdev-migrate 2026-02-17T01:05:35.622 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:05:37.480 INFO:tasks.workunit.client.0.trial092.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-17T01:05:37.500 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:393: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command bluefs-bdev-sizes 2026-02-17T01:05:37.512 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:05:37.997 INFO:tasks.workunit.client.0.trial092.stdout:1 : device size 0x100000000(4 GiB) : using 0x44d4a000(1.1 GiB) : bluefs used 0x44d30000(1.1 GiB) : non-bluefs used 0x1a000(104 KiB) 2026-02-17T01:05:38.046 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:396: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command fsck 2026-02-17T01:05:39.638 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:05:39.712 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:399: TEST_bluestore2: activate_osd td/osd-bluefs-volume-ops 0 2026-02-17T01:05:39.712 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:39.712 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:05:39.712 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T01:05:39.712 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:05:39.712 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-17T01:05:39.712 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=a534615a-caed-4b01-ba5a-82e24d534b92 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-17T01:05:39.712 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:05:39.713 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:05:39.713 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:05:39.713 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-17T01:05:39.713 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-17T01:05:39.713 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:05:39.713 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:05:39.713 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:05:39.713 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:05:39.713 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:05:39.713 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:05:39.713 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:05:39.714 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:05:39.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-17T01:05:39.715 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T01:05:39.715 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T01:05:39.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=a534615a-caed-4b01-ba5a-82e24d534b92 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:05:39.717 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-17T01:05:39.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T01:05:39.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:05:39.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:05:39.717 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:05:39.729 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:39.731+0000 7fc46e1fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:39.730 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:39.732+0000 7fc46e1fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:39.731 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:39.733+0000 7fc46e1fd780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:39.864 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:39.865+0000 7fc46e1fd780 -1 Falling back to public interface 2026-02-17T01:05:39.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T01:05:39.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:05:39.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T01:05:39.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:05:39.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:05:39.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:05:39.945 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:05:39.946 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:05:39.946 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:05:39.946 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:05:40.176 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:05:41.177 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:05:41.178 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:05:41.178 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:05:41.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:05:41.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:05:41.179 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:05:41.430 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:05:42.240 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:42.242+0000 7fc46e1fd780 -1 osd.0 10 log_to_monitors true 2026-02-17T01:05:42.431 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:05:42.431 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:05:42.431 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:05:42.432 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:05:42.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:05:42.432 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:05:42.676 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:05:43.677 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:05:43.678 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:05:43.678 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T01:05:43.678 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-17T01:05:43.678 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:05:43.678 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:05:43.906 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 13 up_thru 13 down_at 10 last_clean_interval [5,10) [v2:127.0.0.1:6800/3578740194,v1:127.0.0.1:6801/3578740194] [v2:127.0.0.1:6802/3578740194,v1:127.0.0.1:6803/3578740194] exists,up 6f11f03b-2aec-4550-b2cc-b0e0c2e465c4 2026-02-17T01:05:43.907 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:05:43.907 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:05:43.908 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:05:43.908 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-17T01:05:43.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: osd_pid0=158473 2026-02-17T01:05:43.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:402: TEST_bluestore2: wait_for_clean 2026-02-17T01:05:43.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T01:05:43.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T01:05:43.909 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T01:05:43.910 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T01:05:43.910 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T01:05:43.910 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T01:05:43.910 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T01:05:43.910 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T01:05:43.910 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T01:05:43.994 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T01:05:43.995 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T01:05:43.995 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T01:05:43.995 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T01:05:43.995 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T01:05:43.995 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T01:05:44.223 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T01:05:44.223 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T01:05:44.223 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T01:05:44.223 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T01:05:44.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-17T01:05:44.290 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-17T01:05:44.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-55834574851' 2026-02-17T01:05:44.291 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T01:05:44.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-55834574851 2026-02-17T01:05:44.291 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T01:05:44.292 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T01:05:44.292 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-55834574851 2026-02-17T01:05:44.292 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T01:05:44.293 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574851 2026-02-17T01:05:44.293 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 55834574851' 2026-02-17T01:05:44.294 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 55834574851 2026-02-17T01:05:44.294 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T01:05:44.531 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 1 -lt 55834574851 2026-02-17T01:05:44.531 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: sleep 1 2026-02-17T01:05:45.532 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T01:05:45.532 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T01:05:45.758 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-17T01:05:45.759 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T01:05:45.759 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T01:05:45.759 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T01:05:46.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-17T01:05:46.082 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T01:05:46.082 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T01:05:46.082 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T01:05:46.082 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T01:05:46.083 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T01:05:46.083 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T01:05:46.083 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T01:05:46.311 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-17T01:05:46.312 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T01:05:46.312 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T01:05:46.312 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T01:05:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-17T01:05:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T01:05:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T01:05:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-17T01:05:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T01:05:46.628 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T01:05:46.629 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T01:05:46.629 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T01:05:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T01:05:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T01:05:46.629 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T01:05:46.736 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T01:05:46.736 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T01:05:46.737 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T01:05:46.737 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T01:05:46.739 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T01:05:46.739 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T01:05:46.739 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T01:05:46.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T01:05:46.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T01:05:46.741 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T01:05:46.741 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T01:05:46.742 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T01:05:46.743 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T01:05:46.743 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T01:05:47.058 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T01:05:47.058 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:47.059 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:47.059 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.109301 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T01:05:47.060 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T01:05:47.062 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T01:05:47.062 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T01:05:47.063 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T01:05:47.063 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T01:05:47.064 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T01:05:47.064 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T01:05:47.064 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T01:05:47.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T01:05:47.065 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T01:05:47.066 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T01:05:47.066 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T01:05:47.067 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T01:05:47.067 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T01:05:47.067 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T01:05:47.069 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T01:05:47.069 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:47.069 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:47.069 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.109301 2026-02-17T01:05:47.070 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T01:05:47.070 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T01:05:47.070 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-17T01:05:47.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-17T01:05:47.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:47.071 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:47.071 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.109301 2026-02-17T01:05:47.072 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-17T01:05:47.072 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-17T01:05:47.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-17T01:05:47.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-17T01:05:47.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore_expand td/osd-bluefs-volume-ops 2026-02-17T01:05:47.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:406: TEST_bluestore_expand: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:47.073 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: ulimit -n 2026-02-17T01:05:47.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: local flimit=4096 2026-02-17T01:05:47.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:409: TEST_bluestore_expand: '[' 4096 -lt 1536 ']' 2026-02-17T01:05:47.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: export CEPH_MON=127.0.0.1:7146 2026-02-17T01:05:47.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: CEPH_MON=127.0.0.1:7146 2026-02-17T01:05:47.073 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:413: TEST_bluestore_expand: export CEPH_ARGS 2026-02-17T01:05:47.074 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: uuidgen 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: CEPH_ARGS+='--fsid=bd27c61f-a9a1-4c7d-b85e-83c42ae7fa3c --auth-supported=none ' 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:415: TEST_bluestore_expand: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:416: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:417: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:418: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:419: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:420: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:421: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:422: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:423: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:425: TEST_bluestore_expand: run_mon td/osd-bluefs-volume-ops a 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-17T01:05:47.075 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:47.097 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-17T01:05:47.097 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:05:47.097 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:05:47.097 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:05:47.097 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:47.097 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:47.097 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:05:47.097 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T01:05:47.125 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-17T01:05:47.126 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-17T01:05:47.126 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T01:05:47.126 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T01:05:47.126 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-17T01:05:47.126 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-17T01:05:47.126 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T01:05:47.126 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T01:05:47.126 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T01:05:47.127 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T01:05:47.127 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:47.127 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:47.127 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.109301/ceph-mon.a.asok 2026-02-17T01:05:47.127 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T01:05:47.127 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.109301/ceph-mon.a.asok config get fsid 2026-02-17T01:05:47.170 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-17T01:05:47.170 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-17T01:05:47.170 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-17T01:05:47.170 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-17T01:05:47.170 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-17T01:05:47.170 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-17T01:05:47.170 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-17T01:05:47.171 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-17T01:05:47.171 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-17T01:05:47.171 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:47.171 INFO:tasks.workunit.client.0.trial092.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:47.171 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.109301/ceph-mon.a.asok 2026-02-17T01:05:47.171 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-17T01:05:47.171 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.109301/ceph-mon.a.asok config get mon_host 2026-02-17T01:05:47.214 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:426: TEST_bluestore_expand: run_mgr td/osd-bluefs-volume-ops x 2026-02-17T01:05:47.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:47.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-17T01:05:47.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-17T01:05:47.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-17T01:05:47.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-17T01:05:47.215 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T01:05:47.323 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-17T01:05:47.323 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:05:47.323 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:05:47.323 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:05:47.323 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:47.323 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:47.324 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:05:47.324 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T01:05:47.324 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T01:05:47.344 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:427: TEST_bluestore_expand: run_osd td/osd-bluefs-volume-ops 0 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=a534615a-caed-4b01-ba5a-82e24d534b92 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=bd27c61f-a9a1-4c7d-b85e-83c42ae7fa3c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-17T01:05:47.345 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:05:47.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:05:47.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:05:47.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:05:47.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:05:47.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-17T01:05:47.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-17T01:05:47.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-17T01:05:47.347 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-17T01:05:47.347 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=8cde1e1b-0031-41fa-ac1b-03848bb1b49c 2026-02-17T01:05:47.348 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 8cde1e1b-0031-41fa-ac1b-03848bb1b49c' 2026-02-17T01:05:47.348 INFO:tasks.workunit.client.0.trial092.stdout:add osd0 8cde1e1b-0031-41fa-ac1b-03848bb1b49c 2026-02-17T01:05:47.348 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-17T01:05:47.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDrvpNpIeGAFRAAhqPHFl7GYj0b2cAO5uNmYQ== 2026-02-17T01:05:47.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDrvpNpIeGAFRAAhqPHFl7GYj0b2cAO5uNmYQ=="}' 2026-02-17T01:05:47.359 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 8cde1e1b-0031-41fa-ac1b-03848bb1b49c -i td/osd-bluefs-volume-ops/0/new.json 2026-02-17T01:05:47.468 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:05:47.474 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-17T01:05:47.475 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=a534615a-caed-4b01-ba5a-82e24d534b92 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=bd27c61f-a9a1-4c7d-b85e-83c42ae7fa3c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDrvpNpIeGAFRAAhqPHFl7GYj0b2cAO5uNmYQ== --osd-uuid 8cde1e1b-0031-41fa-ac1b-03848bb1b49c 2026-02-17T01:05:47.497 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:47.498+0000 7ff367429780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:47.499 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:47.500+0000 7ff367429780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:47.500 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:47.501+0000 7ff367429780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:47.501 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:47.501+0000 7ff367429780 -1 bdev(0x3bd0000 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-17T01:05:47.501 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:47.501+0000 7ff367429780 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-17T01:05:48.298 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-17T01:05:48.299 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-17T01:05:48.299 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-17T01:05:48.300 INFO:tasks.workunit.client.0.trial092.stdout:adding osd0 key to auth repository 2026-02-17T01:05:48.300 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T01:05:48.407 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-17T01:05:48.408 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T01:05:48.408 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=a534615a-caed-4b01-ba5a-82e24d534b92 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=bd27c61f-a9a1-4c7d-b85e-83c42ae7fa3c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:05:48.409 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-17T01:05:48.409 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-17T01:05:48.409 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-17T01:05:48.428 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:48.429+0000 7f91bb025780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:48.430 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:48.431+0000 7f91bb025780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:48.430 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:48.431+0000 7f91bb025780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:05:48.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-17T01:05:48.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:05:48.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T01:05:48.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:05:48.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:05:48.510 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:05:48.511 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:05:48.511 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:05:48.511 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:05:48.511 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:05:48.612 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:05:48.658 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:48.659+0000 7f91bb025780 -1 Falling back to public interface 2026-02-17T01:05:49.253 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:05:49.254+0000 7f91bb025780 -1 osd.0 0 log_to_monitors true 2026-02-17T01:05:49.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:05:49.613 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:05:49.614 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:05:49.614 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:05:49.615 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:05:49.615 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:05:49.849 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4229724389,v1:127.0.0.1:6801/4229724389] [v2:127.0.0.1:6802/4229724389,v1:127.0.0.1:6803/4229724389] exists,up 8cde1e1b-0031-41fa-ac1b-03848bb1b49c 2026-02-17T01:05:49.850 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:05:49.850 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:05:49.850 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:05:49.850 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-17T01:05:49.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: osd_pid0=161031 2026-02-17T01:05:49.851 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:430: TEST_bluestore_expand: sleep 5 2026-02-17T01:05:54.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:431: TEST_bluestore_expand: create_pool foo 16 2026-02-17T01:05:54.852 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-17T01:05:55.134 INFO:tasks.workunit.client.0.trial092.stderr:pool 'foo' already exists 2026-02-17T01:05:55.142 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-17T01:05:56.143 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:434: TEST_bluestore_expand: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-17T01:05:56.167 INFO:tasks.workunit.client.0.trial092.stdout:hints = 1 2026-02-17T01:05:56.167 INFO:tasks.workunit.client.0.trial092.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-17T01:05:56.167 INFO:tasks.workunit.client.0.trial092.stdout:Object prefix: benchmark_data_trial092_162075 2026-02-17T01:05:56.167 INFO:tasks.workunit.client.0.trial092.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T01:05:56.168 INFO:tasks.workunit.client.0.trial092.stdout: 0 0 0 0 0 0 - 0 2026-02-17T01:05:57.167 INFO:tasks.workunit.client.0.trial092.stdout: 1 16 18180 18164 70.9476 70.9531 0.00108457 0.000879856 2026-02-17T01:05:58.167 INFO:tasks.workunit.client.0.trial092.stdout: 2 16 36563 36547 71.3754 71.8086 0.00064123 0.00087467 2026-02-17T01:05:59.167 INFO:tasks.workunit.client.0.trial092.stdout: 3 15 54684 54669 71.1782 70.7891 0.000875825 0.000877244 2026-02-17T01:06:00.167 INFO:tasks.workunit.client.0.trial092.stdout: 4 16 73022 73006 71.2895 71.6289 0.00118333 0.000875887 2026-02-17T01:06:01.167 INFO:tasks.workunit.client.0.trial092.stdout: 5 16 91036 91020 71.104 70.3672 0.000712281 0.000878198 2026-02-17T01:06:02.167 INFO:tasks.workunit.client.0.trial092.stdout: 6 16 108630 108614 70.7069 68.7266 0.00110647 0.000883149 2026-02-17T01:06:03.167 INFO:tasks.workunit.client.0.trial092.stdout: 7 15 125796 125781 70.185 67.0586 0.000895681 0.000889719 2026-02-17T01:06:04.168 INFO:tasks.workunit.client.0.trial092.stdout: 8 16 142737 142721 69.6828 66.1719 0.000880082 0.000896149 2026-02-17T01:06:05.167 INFO:tasks.workunit.client.0.trial092.stdout: 9 16 159929 159913 69.4015 67.1562 0.000945253 0.000899768 2026-02-17T01:06:06.168 INFO:tasks.workunit.client.0.trial092.stdout: 10 16 176450 176434 68.9144 64.5352 0.00117771 0.000906146 2026-02-17T01:06:07.168 INFO:tasks.workunit.client.0.trial092.stdout: 11 16 192734 192718 68.4317 63.6094 0.00107029 0.000912539 2026-02-17T01:06:08.168 INFO:tasks.workunit.client.0.trial092.stdout: 12 16 208827 208811 67.9675 62.8633 0.00158566 0.000918767 2026-02-17T01:06:09.168 INFO:tasks.workunit.client.0.trial092.stdout: 13 15 225060 225045 67.6169 63.4141 0.000833005 0.000923557 2026-02-17T01:06:10.168 INFO:tasks.workunit.client.0.trial092.stdout: 14 15 241313 241298 67.3216 63.4883 0.00102742 0.000927619 2026-02-17T01:06:11.168 INFO:tasks.workunit.client.0.trial092.stdout: 15 16 257710 257694 67.103 64.0469 0.00130335 0.00093065 2026-02-17T01:06:12.168 INFO:tasks.workunit.client.0.trial092.stdout: 16 16 274049 274033 66.8978 63.8242 0.00121979 0.000933507 2026-02-17T01:06:13.168 INFO:tasks.workunit.client.0.trial092.stdout: 17 16 290325 290309 66.7022 63.5781 0.000660334 0.000936237 2026-02-17T01:06:14.168 INFO:tasks.workunit.client.0.trial092.stdout: 18 16 306374 306358 66.4792 62.6914 0.000931387 0.000939405 2026-02-17T01:06:15.168 INFO:tasks.workunit.client.0.trial092.stdout: 19 16 322291 322275 66.2524 62.1758 0.000590775 0.000942619 2026-02-17T01:06:16.168 INFO:tasks.workunit.client.0.trial092.stdout:2026-02-17T01:06:16.171068+0000 min lat: 0.000304866 max lat: 0.0043508 avg lat: 0.000946144 2026-02-17T01:06:16.169 INFO:tasks.workunit.client.0.trial092.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T01:06:16.169 INFO:tasks.workunit.client.0.trial092.stdout: 20 16 337986 337970 66.005 61.3086 0.000812086 0.000946144 2026-02-17T01:06:17.168 INFO:tasks.workunit.client.0.trial092.stdout: 21 16 354162 354146 65.8706 63.1875 0.00066336 0.000948081 2026-02-17T01:06:18.168 INFO:tasks.workunit.client.0.trial092.stdout: 22 16 370275 370259 65.7372 62.9414 0.000934222 0.000950011 2026-02-17T01:06:19.168 INFO:tasks.workunit.client.0.trial092.stdout: 23 16 386191 386175 65.582 62.1719 0.00113198 0.000952251 2026-02-17T01:06:20.168 INFO:tasks.workunit.client.0.trial092.stdout: 24 16 388400 388384 63.209 8.62891 0.0909175 0.000985676 2026-02-17T01:06:21.169 INFO:tasks.workunit.client.0.trial092.stdout: 25 16 388809 388793 60.7445 1.59766 0.0826274 0.00102754 2026-02-17T01:06:22.169 INFO:tasks.workunit.client.0.trial092.stdout: 26 16 389100 389084 58.4519 1.13672 0.0192235 0.00106657 2026-02-17T01:06:23.168 INFO:tasks.workunit.client.0.trial092.stdout: 27 16 389307 389291 56.317 0.808594 0.132395 0.00110719 2026-02-17T01:06:24.169 INFO:tasks.workunit.client.0.trial092.stdout: 28 16 389443 389427 54.3247 0.53125 0.125543 0.00114817 2026-02-17T01:06:25.169 INFO:tasks.workunit.client.0.trial092.stdout: 29 16 389545 389529 52.4652 0.398438 0.157297 0.00118664 2026-02-17T01:06:26.169 INFO:tasks.workunit.client.0.trial092.stdout:Total time run: 30.0011 2026-02-17T01:06:26.169 INFO:tasks.workunit.client.0.trial092.stdout:Total writes made: 395354 2026-02-17T01:06:26.169 INFO:tasks.workunit.client.0.trial092.stdout:Write size: 4096 2026-02-17T01:06:26.169 INFO:tasks.workunit.client.0.trial092.stdout:Object size: 4096 2026-02-17T01:06:26.170 INFO:tasks.workunit.client.0.trial092.stdout:Bandwidth (MB/sec): 51.4765 2026-02-17T01:06:26.170 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Bandwidth: 26.3512 2026-02-17T01:06:26.170 INFO:tasks.workunit.client.0.trial092.stdout:Max bandwidth (MB/sec): 71.8086 2026-02-17T01:06:26.170 INFO:tasks.workunit.client.0.trial092.stdout:Min bandwidth (MB/sec): 0.398438 2026-02-17T01:06:26.170 INFO:tasks.workunit.client.0.trial092.stdout:Average IOPS: 13177 2026-02-17T01:06:26.170 INFO:tasks.workunit.client.0.trial092.stdout:Stddev IOPS: 6745.92 2026-02-17T01:06:26.170 INFO:tasks.workunit.client.0.trial092.stdout:Max IOPS: 18383 2026-02-17T01:06:26.170 INFO:tasks.workunit.client.0.trial092.stdout:Min IOPS: 102 2026-02-17T01:06:26.170 INFO:tasks.workunit.client.0.trial092.stdout:Average Latency(s): 0.00121339 2026-02-17T01:06:26.170 INFO:tasks.workunit.client.0.trial092.stdout:Stddev Latency(s): 0.00507323 2026-02-17T01:06:26.170 INFO:tasks.workunit.client.0.trial092.stdout:Max latency(s): 0.202551 2026-02-17T01:06:26.171 INFO:tasks.workunit.client.0.trial092.stdout:Min latency(s): 0.000304866 2026-02-17T01:06:26.171 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:435: TEST_bluestore_expand: sleep 5 2026-02-17T01:06:31.174 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-17T01:06:31.174 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-17T01:06:31.247 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: total_space_before=4294967296 2026-02-17T01:06:31.248 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-17T01:06:31.248 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-17T01:06:31.248 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep free 2026-02-17T01:06:31.248 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d: -f 2 2026-02-17T01:06:31.248 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d, -f 1 2026-02-17T01:06:31.248 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-17T01:06:31.315 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: free_space_before=2675499008 2026-02-17T01:06:31.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 161031 2026-02-17T01:06:31.316 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: sleep 1 2026-02-17T01:06:32.317 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 161031 2026-02-17T01:06:32.317 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 441: kill: (161031) - No such process 2026-02-17T01:06:32.317 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:442: TEST_bluestore_expand: ceph osd down 0 2026-02-17T01:06:32.547 INFO:tasks.workunit.client.0.trial092.stderr:osd.0 is already down. 2026-02-17T01:06:32.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:445: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 allocmap 2026-02-17T01:06:32.570 INFO:tasks.workunit.client.0.trial092.stdout:allocmap bluestore.allocmap 2026-02-17T01:07:14.918 INFO:tasks.workunit.client.0.trial092.stdout:allocmap success 2026-02-17T01:07:14.949 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:448: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T01:07:58.239 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:07:58.273 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:450: TEST_bluestore_expand: requested_space=4294967296 2026-02-17T01:07:58.273 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:451: TEST_bluestore_expand: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-17T01:07:58.274 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:452: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-17T01:07:58.289 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:08:39.516 INFO:tasks.workunit.client.0.trial092.stdout:1 : device size 0x40000000(1 GiB) : using 0x31800000(792 MiB) 2026-02-17T01:08:39.517 INFO:tasks.workunit.client.0.trial092.stdout:2 : device size 0x100000000(4 GiB) : using 0x60874000(1.5 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x60874000(1.5 GiB) 2026-02-17T01:08:39.517 INFO:tasks.workunit.client.0.trial092.stdout:Expanding DB/WAL... 2026-02-17T01:08:39.517 INFO:tasks.workunit.client.0.trial092.stdout:1 : nothing to do, skipped 2026-02-17T01:08:39.517 INFO:tasks.workunit.client.0.trial092.stdout:2 : nothing to do, skipped 2026-02-17T01:08:39.586 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:455: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T01:09:23.312 INFO:tasks.workunit.client.0.trial092.stdout:fsck success 2026-02-17T01:09:23.346 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:458: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 qfsck 2026-02-17T01:09:23.362 INFO:tasks.workunit.client.0.trial092.stdout:qfsck bluestore.quick-fsck 2026-02-17T01:10:05.233 INFO:tasks.workunit.client.0.trial092.stdout:qfsck success 2026-02-17T01:10:05.261 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:460: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-17T01:10:05.276 INFO:tasks.workunit.client.0.trial092.stdout:inferring bluefs devices from bluestore path 2026-02-17T01:10:46.464 INFO:tasks.workunit.client.0.trial092.stdout:1 : device size 0x40000000(1 GiB) : using 0x31800000(792 MiB) 2026-02-17T01:10:46.465 INFO:tasks.workunit.client.0.trial092.stdout:2 : device size 0x100000000(4 GiB) : using 0x60874000(1.5 GiB) : bluefs used 0x0(0 B) : non-bluefs used 0x60874000(1.5 GiB) 2026-02-17T01:10:46.552 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:462: TEST_bluestore_expand: activate_osd td/osd-bluefs-volume-ops 0 2026-02-17T01:10:46.553 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:10:46.553 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-17T01:10:46.553 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-17T01:10:46.553 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-17T01:10:46.553 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-17T01:10:46.553 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=a534615a-caed-4b01-ba5a-82e24d534b92 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=bd27c61f-a9a1-4c7d-b85e-83c42ae7fa3c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-17T01:10:46.553 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T01:10:46.553 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T01:10:46.553 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T01:10:46.554 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-17T01:10:46.554 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-17T01:10:46.554 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-17T01:10:46.554 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-17T01:10:46.554 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T01:10:46.554 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-17T01:10:46.554 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-17T01:10:46.554 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-17T01:10:46.554 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-17T01:10:46.554 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:10:46.554 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-17T01:10:46.555 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-17T01:10:46.556 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-17T01:10:46.556 INFO:tasks.workunit.client.0.trial092.stdout:start osd.0 2026-02-17T01:10:46.557 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=c8add248-1daa-4062-9d65-6035771adf74 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=0 --fsid=a534615a-caed-4b01-ba5a-82e24d534b92 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=bd27c61f-a9a1-4c7d-b85e-83c42ae7fa3c --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.109301/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T01:10:46.557 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-17T01:10:46.557 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-17T01:10:46.557 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-17T01:10:46.557 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-17T01:10:46.557 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-17T01:10:46.572 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:10:46.575+0000 7fb986231780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:10:46.574 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:10:46.576+0000 7fb986231780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:10:46.574 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:10:46.577+0000 7fb986231780 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T01:10:46.739 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:10:46.742+0000 7fb986231780 -1 Falling back to public interface 2026-02-17T01:10:46.788 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-17T01:10:46.788 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-17T01:10:46.788 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-17T01:10:46.788 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-17T01:10:46.788 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-17T01:10:46.788 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:10:46.789 INFO:tasks.workunit.client.0.trial092.stdout:0 2026-02-17T01:10:46.789 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-17T01:10:46.789 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:10:46.789 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:10:47.022 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:10:48.023 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:10:48.023 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:10:48.023 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-17T01:10:48.024 INFO:tasks.workunit.client.0.trial092.stdout:1 2026-02-17T01:10:48.024 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:10:48.025 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:10:48.267 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:10:49.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:10:49.269 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:10:49.270 INFO:tasks.workunit.client.0.trial092.stdout:2 2026-02-17T01:10:49.270 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-17T01:10:49.271 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:10:49.271 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:10:49.503 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:10:50.504 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:10:50.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:10:50.505 INFO:tasks.workunit.client.0.trial092.stdout:3 2026-02-17T01:10:50.505 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-17T01:10:50.506 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:10:50.506 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:10:50.743 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:10:51.744 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:10:51.744 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:10:51.745 INFO:tasks.workunit.client.0.trial092.stdout:4 2026-02-17T01:10:51.745 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-17T01:10:51.746 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:10:51.746 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:10:51.978 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:10:52.979 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:10:52.979 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:10:52.980 INFO:tasks.workunit.client.0.trial092.stdout:5 2026-02-17T01:10:52.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-17T01:10:52.980 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:10:52.981 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:10:53.211 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:10:54.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:10:54.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:10:54.212 INFO:tasks.workunit.client.0.trial092.stdout:6 2026-02-17T01:10:54.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-17T01:10:54.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:10:54.212 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:10:54.449 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:10:55.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:10:55.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:10:55.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-17T01:10:55.450 INFO:tasks.workunit.client.0.trial092.stdout:7 2026-02-17T01:10:55.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:10:55.451 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:10:55.695 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-17T01:10:56.358 INFO:tasks.workunit.client.0.trial092.stderr:2026-02-17T01:10:56.361+0000 7fb986231780 -1 osd.0 10 log_to_monitors true 2026-02-17T01:10:56.696 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-17T01:10:56.696 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-17T01:10:56.696 INFO:tasks.workunit.client.0.trial092.stdout:8 2026-02-17T01:10:56.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-17T01:10:56.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-17T01:10:56.697 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-17T01:10:56.929 INFO:tasks.workunit.client.0.trial092.stdout:osd.0 up in weight 1 up_from 13 up_thru 13 down_at 10 last_clean_interval [5,10) [v2:127.0.0.1:6800/3159397123,v1:127.0.0.1:6801/3159397123] [v2:127.0.0.1:6802/3159397123,v1:127.0.0.1:6803/3159397123] exists,up 8cde1e1b-0031-41fa-ac1b-03848bb1b49c 2026-02-17T01:10:56.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-17T01:10:56.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-17T01:10:56.930 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-17T01:10:56.930 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-17T01:10:56.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: osd_pid0=164440 2026-02-17T01:10:56.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:465: TEST_bluestore_expand: wait_for_clean 2026-02-17T01:10:56.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-17T01:10:56.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-17T01:10:56.931 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-17T01:10:56.931 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T01:10:56.932 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-17T01:10:56.932 INFO:tasks.workunit.client.0.trial092.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-17T01:10:56.932 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-17T01:10:56.932 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-17T01:10:56.932 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-17T01:10:57.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T01:10:57.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-17T01:10:57.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-17T01:10:57.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-17T01:10:57.018 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-17T01:10:57.018 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-17T01:10:57.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-17T01:10:57.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-17T01:10:57.251 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-17T01:10:57.251 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: timeout 300 ceph tell osd.0 flush_pg_stats 2026-02-17T01:10:57.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-17T01:10:57.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-17T01:10:57.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: seqs=' 0-55834574851' 2026-02-17T01:10:57.323 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: for s in $seqs 2026-02-17T01:10:57.323 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: echo 0-55834574851 2026-02-17T01:10:57.323 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: cut -d - -f 1 2026-02-17T01:10:57.324 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: osd=0 2026-02-17T01:10:57.324 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-55834574851 2026-02-17T01:10:57.325 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 2 2026-02-17T01:10:57.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: seq=55834574851 2026-02-17T01:10:57.326 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 'waiting osd.0 seq 55834574851' 2026-02-17T01:10:57.326 INFO:tasks.workunit.client.0.trial092.stdout:waiting osd.0 seq 55834574851 2026-02-17T01:10:57.326 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T01:10:57.562 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-17T01:10:57.562 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-17T01:10:57.562 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T01:10:57.563 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T01:10:57.894 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-17T01:10:57.894 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-17T01:10:57.895 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-17T01:10:57.895 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-17T01:10:57.895 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T01:10:57.895 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T01:10:57.895 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T01:10:57.895 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T01:10:58.127 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-17T01:10:58.127 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T01:10:58.127 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-17T01:10:58.128 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T01:10:58.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-17T01:10:58.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-17T01:10:58.450 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-17T01:10:58.451 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-17T01:10:58.451 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-17T01:10:58.522 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: total_space_after=4294967296 2026-02-17T01:10:58.523 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-17T01:10:58.523 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-17T01:10:58.523 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep free 2026-02-17T01:10:58.523 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d: -f 2 2026-02-17T01:10:58.523 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d, -f 1 2026-02-17T01:10:58.523 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-17T01:10:58.590 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: free_space_after=2645442560 2026-02-17T01:10:58.590 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:470: TEST_bluestore_expand: '[' 4294967296 '!=' 4294967296 ']' 2026-02-17T01:10:58.590 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:476: TEST_bluestore_expand: total_space_added=0 2026-02-17T01:10:58.591 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:477: TEST_bluestore_expand: free_space_added=-30056448 2026-02-17T01:10:58.591 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:479: TEST_bluestore_expand: let 'new_used_space=(0 - -30056448)' 2026-02-17T01:10:58.591 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:480: TEST_bluestore_expand: echo 30056448 2026-02-17T01:10:58.591 INFO:tasks.workunit.client.0.trial092.stdout:30056448 2026-02-17T01:10:58.592 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:482: TEST_bluestore_expand: '[' 30056448 -gt 131072 ']' 2026-02-17T01:10:58.592 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:483: TEST_bluestore_expand: echo 'total_space_added = 0' 2026-02-17T01:10:58.592 INFO:tasks.workunit.client.0.trial092.stdout:total_space_added = 0 2026-02-17T01:10:58.592 INFO:tasks.workunit.client.0.trial092.stdout:free_space_added = -30056448 2026-02-17T01:10:58.594 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:484: TEST_bluestore_expand: echo 'free_space_added = -30056448' 2026-02-17T01:10:58.594 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:485: TEST_bluestore_expand: return 1 2026-02-17T01:10:58.594 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: return 1 2026-02-17T01:10:58.594 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2402: main: code=1 2026-02-17T01:10:58.594 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2404: main: teardown td/osd-bluefs-volume-ops 1 2026-02-17T01:10:58.595 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T01:10:58.595 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=1 2026-02-17T01:10:58.595 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T01:10:58.595 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-17T01:10:58.595 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-17T01:10:58.595 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-17T01:10:58.595 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-17T01:10:58.595 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-17T01:10:58.696 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-17T01:10:58.696 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-17T01:10:58.698 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T01:10:58.698 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-17T01:10:58.699 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T01:10:58.699 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-17T01:10:58.700 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-17T01:10:58.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T01:10:58.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-17T01:10:58.701 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-17T01:10:58.701 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T01:10:58.702 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T01:10:58.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 1 = 1 ']' 2026-02-17T01:10:58.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: '[' -n '' ']' 2026-02-17T01:10:58.703 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:185: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2026-02-17T01:10:58.704 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:186: teardown: mv td/osd-bluefs-volume-ops/bluestore_tool.log td/osd-bluefs-volume-ops/mgr.x.log td/osd-bluefs-volume-ops/mon.a.log td/osd-bluefs-volume-ops/osd.0.log /home/ubuntu/cephtest/archive/log 2026-02-17T01:10:58.705 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T01:10:58.781 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-17T01:10:58.781 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-17T01:10:58.781 INFO:tasks.workunit.client.0.trial092.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.109301 2026-02-17T01:10:58.781 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.109301 2026-02-17T01:10:58.782 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-17T01:10:58.782 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-17T01:10:58.782 INFO:tasks.workunit.client.0.trial092.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: return 1 2026-02-17T01:10:58.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T01:10:58.782 INFO:tasks.workunit:Stopping ['osd'] on client.0... 2026-02-17T01:10:58.782 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T01:10:59.141 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_ceph-c_03ef619e79a56cd363b087a5c6f19a1a09b49040/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_03ef619e79a56cd363b087a5c6f19a1a09b49040/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_ceph-c_03ef619e79a56cd363b087a5c6f19a1a09b49040/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/remote.py", line 575, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial092 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03ef619e79a56cd363b087a5c6f19a1a09b49040 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' 2026-02-17T01:10:59.144 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T01:10:59.159 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T01:10:59.159 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T01:10:59.296 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T01:10:59.308 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T01:10:59.308 DEBUG:teuthology.orchestra.run.trial092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T01:10:59.324 INFO:teuthology.orchestra.run.trial092.stderr:bash: line 1: ntpq: command not found 2026-02-17T01:10:59.351 INFO:teuthology.orchestra.run.trial092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T01:10:59.351 INFO:teuthology.orchestra.run.trial092.stdout:=============================================================================== 2026-02-17T01:10:59.352 INFO:teuthology.orchestra.run.trial092.stdout:^- 139-177-202-26.ip.linode> 2 7 377 12 -12ms[ -12ms] +/- 79ms 2026-02-17T01:10:59.352 INFO:teuthology.orchestra.run.trial092.stdout:^* wsip-24-249-17-253.dc.dc> 2 7 377 9 +708us[ +616us] +/- 9610us 2026-02-17T01:10:59.352 INFO:teuthology.orchestra.run.trial092.stdout:^- time-west.far.net 2 6 377 14 -4808us[-4900us] +/- 59ms 2026-02-17T01:10:59.352 INFO:teuthology.orchestra.run.trial092.stdout:^- 172-234-25-10.ip.linodeu> 2 6 377 12 -7864us[-7956us] +/- 75ms 2026-02-17T01:10:59.354 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T01:10:59.366 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T01:10:59.366 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T01:10:59.381 DEBUG:teuthology.orchestra.run.trial092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T01:10:59.446 DEBUG:teuthology.orchestra.run.trial092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-17T01:10:59.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T01:10:59.472 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T01:10:59.483 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T01:10:59.497 INFO:teuthology.task.internal:Duration was 1625.032780 seconds 2026-02-17T01:10:59.498 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T01:10:59.515 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T01:10:59.515 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T01:10:59.552 INFO:teuthology.orchestra.run.trial092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T01:10:59.943 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T01:10:59.943 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial092.front.sepia.ceph.com 2026-02-17T01:10:59.944 DEBUG:teuthology.orchestra.run.trial092:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T01:11:00.002 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T01:11:00.003 DEBUG:teuthology.orchestra.run.trial092:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T01:11:00.101 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T01:11:00.101 DEBUG:teuthology.orchestra.run.trial092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T01:11:00.126 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T01:11:00.126 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T01:11:00.126 INFO:teuthology.orchestra.run.trial092.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T01:11:00.126 INFO:teuthology.orchestra.run.trial092.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T01:11:00.126 INFO:teuthology.orchestra.run.trial092.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T01:11:00.136 INFO:teuthology.orchestra.run.trial092.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 81.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T01:11:00.138 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T01:11:00.155 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T01:11:00.156 DEBUG:teuthology.orchestra.run.trial092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T01:11:00.203 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T01:11:00.215 DEBUG:teuthology.orchestra.run.trial092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T01:11:00.266 INFO:teuthology.orchestra.run.trial092.stdout:kernel.core_pattern = core 2026-02-17T01:11:00.278 DEBUG:teuthology.orchestra.run.trial092:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T01:11:00.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T01:11:00.334 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T01:11:00.350 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T01:11:00.353 DEBUG:teuthology.misc:Transferring archived files from trial092:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-13_08:57:15-rados-wip-ifed-fix-vselector-in-envmode_index_file-distro-default-trial/48647/remote/trial092 2026-02-17T01:11:00.354 DEBUG:teuthology.orchestra.run.trial092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T02:19:22.379 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T02:19:22.385 DEBUG:teuthology.orchestra.run.trial092:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T02:19:26.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T02:19:26.739 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T02:19:26.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T02:19:26.754 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T02:19:26.755 DEBUG:teuthology.orchestra.run.trial092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T02:19:26.771 INFO:teuthology.orchestra.run.trial092.stdout: 786525 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 02:19 /home/ubuntu/cephtest 2026-02-17T02:19:26.772 INFO:teuthology.orchestra.run.trial092.stdout: 1048591 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 00:48 /home/ubuntu/cephtest/mnt.0 2026-02-17T02:19:26.772 INFO:teuthology.orchestra.run.trial092.stdout: 1048592 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 00:58 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T02:19:26.772 INFO:teuthology.orchestra.run.trial092.stdout: 1048637 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 00:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T02:19:26.772 INFO:teuthology.orchestra.run.trial092.stdout: 1064487 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 01:10 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2026-02-17T02:19:26.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T02:19:26.773 INFO:teuthology.orchestra.run.trial092.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-17T02:19:26.774 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial092 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T02:19:26.778 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T02:19:26.795 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T02:19:26.812 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial092 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T02:19:26.819 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{centos_latest} workloads/osd} duration: 1625.032779932022 failure_reason: 'Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial092 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=03ef619e79a56cd363b087a5c6f19a1a09b49040 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh''' flavor: default owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-17T02:19:26.819 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T02:19:26.954 INFO:teuthology.run:FAIL